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^ : Abstract 
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In this paper the asymptotic behavior of the conditional least squares estimators of 
the autoregressive parameters (q, /3) and of the stability parameter q := a + /3 for an 
unstable integer- valued autoregressive process Xk = a o X^-i + (3 o Xk-2 + ^k-, A; G N, 
is described. The limit distributions and the scaling factors are different according to the 
following three cases: (i) decomposable, (ii) indecomposable but not positively regular, 
and (iii) positively regular models. 



>! 1 Introduction 

^ The theory and practice of statistical inference for integer-valued time series models are rapidly 
■ developing and important topics of the modern theory of statistics. A number of results are 
now available in specialized monographs and review papers, to name a few, see, e.g., Steutel 
and van Harn [29] and WeiB [32]. Among the most successful integer- valued time series models 
proposed in the literature we mention the INteger-valued AutoRegressive model of order p 
^ ■ (INAR(p)). This model was first introduced by McKenzie [21] and Al-Osh and Alzaid [1] for 
^ ■ the case p = 1. The INAR(l) model has been investigated by several authors. The more 
general INAR(p) processes were first introduced by Al-Osh and Alzaid [2]. In their setup the 
autocorrelation structure of the process corresponds to that of an ARMA(p, p — 1) process. 
Another definition of an INAR(p) process was proposed independently by Du and Li [9] and by 
Gauthier and Latour [12] and Latour [23], and is different from that of Alzaid and Al-Osh [2]. 
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In Du and Li's setup the autocorrelation structure of an INAR(p) process is the same as that 
of an AR(p) process. The setup of Du and Li [H] has been followed by most of the authors, and 
our approach will also be the same. In Barczy et al. |1] we investigated the asymptotic behavior 
of unstable INAR(p) processes, i.e., when the characteristic polynomial has a unit root. Under 
some natural assumptions we proved that the sequence of appropriately scaled random step 
functions formed from an unstable INAR(p) process converges weakly towards a squared Bessel 
process. This limit process is a continuous branching process also known as square-root process 
or Cox-Ingersoll-Ross process. 

Parameter estimation for INAR(p) models has a long history. Franke and Seligmann [TT] 
analyzed conditional maximum likelihood estimator of some parameters (including the au- 
toregressive parameter) for stable INAR(l) models with Poisson innovations. Du and Li [9l 
Theorem 4.2] proved asymptotic normality of the conditional least squares (CLS) estimator 
of the autoregressive parameters for stable INAR(p) models (see also Latour [231 Proposition 
6.1]), Brannas and Hellstrom [B] considered generalized method of moment estimation. Silva 
and Oliveira [27] proposed a frequency domain based estimator of the autoregressive parame- 
ters for stable INAR(p) models with Poisson innovations. Ispany et al. [15] derived asymptotic 
inference for nearly unstable INAR(l) models which has been refined by Drost et al. [8] later. 
Drost et al. [7] studied asymptotically efficient estimation of the parameters for stable INAR(p) 
models. The stability parameter g := ai + ■ ■ ■ + ap of an INAR(p) model with autoregres- 
sive parameters (ai,...,ap) has not been treated yet, but this stability parameter is well 
investigated in case of unstable AR(p) processes, see the unit root tests, e.g., in Hamilton [131 
Section 17, Table 17.3, Case 1]. Namely, for the simplicity in case of p = 1, if {Yk)k^x+ is 
an AR(1) process, i.e., = gY^^i + (k, k & N, with Yq := and an i.i.d. sequence (Cfc)fceN 
having mean and positive variance, then the ordinary least squares estimator of the stability 
parameter g based on the sample Y„ := (Yi, . . . , Yn) takes the form 

Z^fc=l 

see, e.g., Hamilton [131 17.4.2], and, by Hamilton [T3l 17.4.7], in the unstable case, i.e., when 
^ = 1, 

n(o„(Y„) — 1) — y -^^-j as n — )■ oo, 

where (Wt)t^o is a standard Wiener process and — )■ denotes convergence in distribution. 
Here ?t,(^„(Y„) — 1) known as the Dickey-Fuller statistics. We call the attention that in case 
of unstable INAR(2) processes a new type of limit distribution occurs, see Theorem 12.11 

In this paper the asymptotic behavior of the CLS estimators of the autoregressive and 
stability parameters for unstable INAR(2) models is described, see our main results in Section 
[21 The study of unstable INAR(2) models can be considered as the first step of examining 
general unstable INAR(p) processes and critical branching processes. 

First we recall INAR(2) models. Let Z_|_, N, M and R_|_ denote the set of non- negative 
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integers, positive integers, real numbers and non-negative real numbers, respectively. Every 
random variable will be defined on a fixed probability space {Q, A, P). 



1.1 Definition. Let {ek)km be an independent and identically distributed (i.i.d.) sequence 
of non-negative integer-valued random variables, and let (a, /3) G [0,1]^. An INAR(2) time 
series model with autoregressive parameters and innovations (efc)^^^ « stochastic 

process {Xk)k^-.i given by 

(1-1) ^k=Y^ ^k,j + Yl ^'^'i + ^ ^ 

i=i i=i 

where for all kEN, {^k,j)j€N o-nd [rik^j)j<zn are sequences of i.i.d. Bernoulli random variables 
with mean a and (3, respectively, such that these sequences are mutually independent and 
independent of the sequence {ek)km! o.iT'd Xq and X_i are non-negative integer-valued 
random variables independent of the sequences {C,k,j)j£N, {'>lk,j)jeN, kEN, and {ek)km- 

The INAR(2) model fll.ip can be written in another way using the binomial thinning oper- 
ator o (due to Steutel and van Harn [22]) which we recall now. Let X be a non- negative 
integer-valued random variable. Let (■CjOjeN be a sequence of i.i.d. Bernoulli random variables 
with mean a G [0,1]. We assume that the sequence is independent of X. The 

non-negative integer- valued random variable a o X is defined by 

^ ,Ee„ ifx>o, 

a o X := \ j=i 

0, if X = 0. 

The sequence (^j)j6N is called a counting sequence. Then the INAR(2) model (11. ip takes the 
form 

Xk = ao Xk-i + (3o Xk-2 + ek, ke N. 

Note that the above form of the INAR(2) model is quite analogous with a usual AR(2) process 
(another slight link between them is the similarity of some conditional expectations, see (13. ip ). 

Based on the asymptotic behavior of K{Xk) as /c — )■ oo described in Barczy et al. [U 
Proposition 2.6], we distinguish three types of INAR(2) models. The asymptotic behavior of 
E(Xfc) as /c — )■ oo is determined by the spectral radius r of the matrix 
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i.e., by the maximum of the modulus of the eigenvalues of A. The case r < 1, when K{Xk) 
converges to a finite limit as k ^ oo, is called stable or asymptotically stationary, whereas 
the cases r = 1, when E(Xfc) tends linearly to oo, and r > 1, when E(Xfc) converges to 
oo with an exponential rate, are called unstable and explosive, respectively. It is easy to check 
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that r < 1, r = 1, and r > 1 are equivalent with g < I, = 1, and g > I, respectively, 
where g := a + P is called the stability parameter, see Barczy et al. [H Proposition 2.2]. 

We also note that an INAR(2) process can be considered as a special 2-type branching 
process with immigration. Namely, by (11. ip . 
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+ 



£k 




A; e N, 



and hence the so-called mean matrix of an INAR(2) process with autoregressive parameters 
(a, (3) (considered as a 2-type branching process) is nothing else but A. This process is called 
positively regular if there is a positive integer /c e N such that the entries of are positive 



(see Kesten and Stigum [20]), which is equivalent with a > and f3 > 0. The model is 
called decomposable if the matrix A is decomposable (see Kesten and Stigum |22]), which is 
equivalent with /3 = 0. If a = and /3 > 0, then the process is indecomposable but not 
positively regular (see Kesten and Stigum [21]). If a > and /3 = 0, then the decomposable 
process {Xk)k^-i is an INAR(l) process with autoregressive parameter a. If a = and 
/3 > 0, then the indecomposable process {Xk)k^^i takes the form 



Xk — P O Xk-2 



£k, keN, 



and hence the subsequences {X2k-j)k^o, j = 0, 1, form independent positively regular INAR(l) 
processes with autoregressive parameter /3 such that X^j = 0, j = 0, 1. For more details of 
this classification of INAR(2) processes, see Appendix |Al 

For the sake of simplicity we consider a zero start INAR(2) process, that is we suppose 
Xq = X_i = 0. The general case of nonzero initial values may be handled in a similar way, 
but we renounce to consider it. 

In the sequel we always assume IE(e?) < oo. Let us denote the mean and variance of ei 
by fis and cr^, respectively, which are assumed to be known. Further, we assume /i^ > 0, 
otherwise Xk = for all G N. 

Section [2] contains our main results. Section [3] is devoted to the preliminaries on CLS esti- 
mators. Sections H]- [8] contain the proofs, in Section [9] we present estimates for the moments of 
the processes involved. Appendix |X1[B], and [0 is for the classification of INAR(2) processes, for 
a version of the continuous mapping theorem, and for convergence of random step processes, 
respectively. 



2 Main results 



In what follows we always assume g = a + P = 1, that is, the process {Xk)k^-i is unstable. 
For each n G N, any CLS estimator (S„(X„), /3„(X„)) of the autoregressive parameters 
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based on a sample X„ : 

' n 



(A'l 



has the form 

-1 



k-2 



Xl^2 



E 

k=l 



{Xk — fJ'e)Xk~l 
{Xk — fle)Xk-2 



on the set {co e Q : J2l=i X k-2{^^? > 0} with hm^^^o P (ELi ^1-2 > O) = 1, see 
Proposition 13. 1[ Moreover, for each n G N, any CLS estimator of the stabihty parameter g 
takes the form 

QniXn) = aniX„) + /3„,(X„) 

on the set {u E Q : J2k=i Xk-2{^y > 0}, see Section O 

2.1 Theorem. Let {Xk)k^-i be an INAR(2) process with parameters (a, /3) G (0,1)^ such 
that a + P = 1 (hence it is unstable and positively regular). Suppose that Xq = X_i = 0, 
^{ef) < oo and > 0. Then 



(2.1) 

and 

(2.2) 



n 



{MXn) - 1) 



ra^/2(^a„(X„) - a) 
nV2(3:„(x„) - f3) 



as n ^ oo, 



V«(l + /5) 



1 



as n ^ oo, 



dXt = — ^ {l^e dt + V^2a/3A'+ d ) , te 



where {Xt)t&'&+ is the unique strong solution of the stochastic differential equation (SDE) 
(2^3) d^, = 

with initial value Xq = 0, where (yVt)t£R+, (yVt)t£M+ are independent standard Wiener 
processes, and denotes the positive part of a; G M. 

2.1 Remark. The SDE fl2.3p has a unique strong solution {xl;^^)t^Q for all initial values 



(x) 



X G 



Indeed, since \\/x — y/y\ ^ — y\ for x,y ^ 0, the coefficient functions 
M 9 X H- fie/ (1 + P) and M 3 x H- \/2af3x'^/ (1 + f3) satisfy conditions of part (ii) of Theorem 
3.5 in Chapter IX in Revuz and Yor [26] or the conditions of Proposition 5.2.13 in Karatzas 
and Shreve [I9]. Further, by the comparison theorem (see, e.g., Revuz and Yor [261 Theorem 
3.7, Chapter IX]), if the initial value Xq^^ = x is nonnegative, then xj;^'^ is nonnegative for 
all t G M+ with probability one. Hence Xf)' may be replaced by Xf under the square root 
in (12. 3p . The unique strong solution of the SDE (12. 3p is known as a squared Bessel process, a 
squared-root process or a Cox-Ingersoll-Ross (CIR) process. □ 



2.2 Remark. By Ito's formula and Remark 12.11 Ait 
unique strong solution of the SDE 



;i + f3)Xt - fist, t G M+, is the 



(2.4) 



dMt 
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with initial value A^o = 0, and (A^t + /igt)"'" may be replaced by A^j + zi^t under the square 
root in ( 12 ■4p . Hence dA^j = ^/2a(3Xt dVVt, and the convergence (12.1 p can also be formulated 
as 



(2.5) 



n(Pn(Xn) — 1 — >■ -^h 



as n — 7- oo. 



□ 



The next theorem contains our result for decomposable unstable INAR(2) processes. 

2.2 Theorem. Let {Xk)k^^i he an INAR(2) process with parameters (1,0) (hence it is 
unstable and decomposable). Suppose that Xq = X„i = 0, ^{ef) < oo and > 0. Then 



(2.6) 
and 
(2.7) 



n' 



3/2 



as n ^ oo, 



nV2(S„(X„)-l) 



2a. 



-1 
1 



as n ^ oo, 



where Z is a standard normally distributed random variable. 

The last theorem contains our result for unstable, indecomposable but not positively regular 
INAR(2) processes. 

2.3 Theorem. Let {Xk)k^-i be an INAR(2) process with parameters (0, 1) (hence it is 
unstable, indecomposable but not positively regular). Suppose that Xq = X_i = 0, IE(£^i) < oo 
and > 0. Then 



(2.8) 
and 

(2.9) 



as n ^ oo. 



nan{Xn) 
r^(A^(X„) - 1) 



as n ^ oo. 



where {yVt)tm.+ is a standard Wiener process. 

2.3 Remark. We note that in all unstable cases the limit distributions for the estimators of 
the autoregressive parameters are concentrated on the same line {(x, y) : x + y = 0}. 

However, these limit distributions are pairwise different. Surprisingly, both in the unstable 
positively regular case and in the unstable decomposable case the scaling factor is i/n, while 
in the unstable, indecomposable but not positively regular case it is n. In the stable case 
this factor is again ^Jn (see Du and Li [9l Theorem 4.2] or Latour [231 Proposition 6.1]). 
The reason of this strange phenomena can be understood from the asymptotic behavior of the 
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sequence (A„, dn)nm of random vectors defined and analyzed in Sections [HI HI [5], [7] and [HI 
Namely, the scaling factor of the entries of the matrices {An)neN as well as the entries of 
the vectors (<i„)„gN are different. In order to get over these difficulties, we use the canonical 
form of the process {Xk)km due to Sims, Stock and Watson [28]. One of the decisive tools 
in deriving the needed asymptotic behavior is a good bound for the moments of the involved 
processes, see Corollary 19.1 [ □ 

2.4 Remark. We recall that the distribution of Wt dW*/ Jq dt in Theorem 12.31 agrees 
with the limit distribution of the Dickey-Fuller statistics for unit root test of AR(1) time series, 
see, e.g., Hamilton [T^ 17.4.2 and 17.4.7] or Tanaka [SDJ (7.14) and Theorem 9.5.1]. The shape 
of /o Xt dMt/ Xl dt in ([23]) is similar. The shape of Xt dWt/ Jo Xt dt in Theorem [O 
is also similar, but it contains two independent standard Wiener processes. This phenomena is 
very similar to the appearing of two independent standard Wiener processes in limit theorems 
for CLS estimators of the variance of the offspring and immigration distributions for critical 
branching processes with immigration in Winnicki [331 Theorems 3.5 and 3.8]. Finally, note 
that the limit distribution of the CLS estimator of the stability parameter g is symmetric in 
Theorems 12.21 and 12. 3[ and non-symmetric in Theorem 12.11 but the limit distribution of the 
CLS estimator of the autoregressive parameters (a,/3) is symmetric in Theorems 12.11 and 12 . 2 ^ 
and non-symmetric in Theorem 12.31 Indeed, since {yVt)tm+ and {yVt)tm+ are independent, 
by the SDK (12.31) . the processes {Xt)tm+ and (yVt)tm+ are also independent, which yields 
that the limit distribution of the CLS estimator of the stability parameter g is symmetric in 
Theorem [2H □ 

2.5 Remark. We note that an eighth order moment condition on the innovation distribution 
in Theorem 12.11 is supposed (i.e., we suppose IE(£:^) < oo), which is used for checking the so 
called conditional Lindeberg condition of a martingale central limit theorem (see the proof of 
Theorem 12. ip . However, it is important to remark that this condition is a technical one, we 
suspect that Theorem 12.11 remains true under fourth order moment condition on the innovation 
distribution, but we renounce to consider it. □ 

The proof of Theorems 12. 1^ 12.21 and 12.31 are presented in the remaining sections. Note 
that Barczy et al. [5] contains different proofs in cases of unstable decomposable and of unsta- 
ble, indecomposable but not positively regular INAR(2) processes for the asymptotics of the 
autoregressive parameters. 

3 CLS estimators 

For all k G let us denote by J-^ the a- algebra generated by the random variables 

Xq, Xi, . . . , Xk. (Note that Jq = 0}, since Xq = X_i = 0.) By ([TTT]) . 

(3.1) E{Xk\Tk-i) = aXk^i + pXk-2 + fie, keN. 
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Let us introduce the sequence 

(3.2) Mk := Xfe - E(Xfc | J^k^{) = - «Xfc_i - /3Xfc_2 - 



A; G N, 



of martingale differences with respect to the filtration {J^k)k£Z+ ■ The process (Xfc)fc^_i satisfes 
the recursion 



(3.3) 



For each n G N, a CLS estimator (a.„(X„), /3„(X„)) of the parameters (a, /3) based on 
a sample X„ = (Xi, . . . , X„) can be obtained by minimizing the sum of squares 



(3.4) 



i^k - E(Xfc I J-fc_i))' = ^(Xfc - aXfe„i - pXk-2 - fief 

let us put 



k=l 



k=l 



with respect to (a, /3) over M . For all G N and xi, . . . , a;„ G 

and in what follows we use the convention 

x_i := Xq := 0. 

For all n G N, we define the function Qn : M" x M by 



Q„(a;„; a', /3') := ^(x^ - a'xk-i - P'xk-2 - f^e 



k=l 



for all a', /?' G M and Xn G M". By definition, for all n G N, a CLS estimator of the 
parameters (a, /3) is a measurable function (a„, /J^t) : — t- such that 

Qn{Xn]an{Xn),dn{Xn)) = luf (5„(a;„; tt', /?') Va3„GM". 

(a',/3')6lR2 

Next we give the solutions of this extremum problem. 

3.1 Lemma. For each n G N, any CLS estimator of the parameters (a, /3) is a measurable 
function («„, /3„) : M" — )■ for which 



(3.5) 

«/ YJk=i^k-2 > 0; ^^ere 

n 
k=l 

and 

(3.6) an(a;„) 
^/ Xi = ■ ■ ■ = Xn~2 = and 7^ 0. 



FniXn) QniXn)^ 



Xk^l Xk-lXk-2 
2 

Xk—lXk—2 •^k-2 



9n [Xf, 



k=l 



{Xk - fle)Xk-l 
{Xk - fJ'e)Xk~2 



Xn /^e 
Xn—1 
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Note that /3„,) is not defined uniquely on the set G M" : xi = ■ ■ ■ = Xn-2 = 0}. 
Namely, if Xi = ■ ■ ■ = x„,_2 = and 7^ 0, then /3„ can be chosen as an arbitrary 

measurable function, while if Xi = ■ ■ ■ = = 0, then the same holds for (q?„,/3„). We 
call the attention that Lemma [3.11 holds for all types of INAR(2) processes, i.e., it covers the 
stable, unstable and explosive cases as well. 

Proof of Lemma 13.11 For any fixed G M" with Ym:=i ^1-2 > 0' quadratic function 
3 {a', /3') I— 7- Qn{Xn', a', P') can be written in the form 



Qnixn] a' , /3') 
where 



a' 



T 



QniS^n) • ^ ^ (-^fc /^e) QniS^n) FniS^ri) Qni^'^ri)- 
k=l 

The matrix F„ (a;„) is strictly positive definite, since ^fc=ia:^_2>0 implies that X]fc=i^i-i > 
and 

n n / \ ^ 

det(F„(x„)) = ^ x^„2 - I Yl ^k~iXk~2 j > 0. 

k=l k=l \k=l J 

Indeed, since Ylk=i ^1-2 > 0' there exists some i G — 2} such that Xj 7^ and hence 

there does not exist a constant c G M such that (xq, Xi, . . . , x„_i) 7^ c(x„i, xq, . . . , x„_2)- Then 
(xo, Xi, . . . , x„_i) and (x„i, Xq, . . . , x„_2) are linearly independent, and, by Cauchy-Schwarz 
inequality, we get 

n n / " 

Y^k~i^^k-2 > I 5]]a;fc_iXfc_2 

k=l k=l \k=l 

Hence we obtain (13. 5p . 

For any fixed x„ G with Xi = ■ ■ ■ = x„_2 = and x^-i 7^ 0, the quadratic function 
9 (a', /?') H- Qn{xn] a', /?') can be written in the form 

Qn{Xn; a, /?') = [a'Xn-l - {Xn " /ie))^ + (^n-l - /ij)^ + (n - 2)/i^, («', /3') G 

thus we conclude (13.61) . 

If Xn G M" with xi = ■ ■ ■ = x„_i = then Qn{xn; a', (3') = (x„ — /z^)^ + (n — does 
not depend on the parameters which concludes the statement. □ 

We note that one can find a different proof of this lemma in Barczy et al. [21 Lemma 2.1]. 

Next we present a result about the existence and uniqueness of 

3.1 Proposition. Let {Xk)k^_i be an IN AIi{2) process with parameters (a, /3) G [0, 1]^ such 
that a + /3 = 1 (hence it is unstable). Suppose that Xq = X_i = 0, ^{ef) < 00 and /x^ > 0. 
Then 



limPK]xt2>0 =1, 



a-1 

9 



and hence the probability of the existence of a unique CLS estimator (S„,(X„), con- 
verges to 1 as n — )■ oo, and this CLS estimator has the form 



(3.7) 



on the set {u eVL: X]fc=i ^fc-2(i^)^ > 0}, where 



Fn '■— Fn{Xn) — 



k=l 



9n ■= 9n{Xn) = ^ 



k=l 



{Xk — fie)Xk-2 



Proof. First we prove the statements for {a,/3) G (0,1)^. For each n G N, consider the 
random step process 

where [xj denotes the integer part of a real number x G M. By Barczy et al. [U Theorem 
3.1] we have 



(3.8) 



as n — )■ oo, 



where the process {Xt)tm+ is the unique strong solution of the SDK (12. 3p with initial value 
= 0. Next we show that 



(3.9) 



1 " c 

— > Xlo — ^ / '^t as n — oo. 



Let us apply Lemmas IB. 21 and IB. 31 with the special choices d := p := q := 1^ /i:M— t-M, 
h{x) := X, X G M, K : [0, 1] x ^ M, 

K{s, xi, X2) := Xi, (s, xi, X2) G [0, 1] x M^, 

and U := X, W^") := neN. Then 

|i^'(s,xi,X2) - K{t,yi,y2)\ = \xl - yfl ^ (|xi| + |yi|)|xi - yi\ ^ 2R{\t - s\ + |xi - yi\) 

^2i?(|t-s| + ||(xi,X2) -(1/1,1/2)11) 

for all s,tG [0,1] and (xi, X2), (yi, 1/2) G with ||(xi,X2)|| ^ -R and \\{yi,y2)\\ ^ R, where 
R>0. Further, using the definition of $ and $„, n G N, given in Lemma IB. 3t 



\ fc=l / \ k=l 



^k I ' 
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Since the process {Xt)t^R_^ admits continuous paths with probabihty one, Lemma IB.2I (with 
the choice C := C(M+,M)) and LemmaElyield ([S3]). Since /i^ > 0, by the SDE ([23]), we 
have ¥{Xt = 0, t G [0, 1]) = 0, which imphes that ¥{J^X^dt > O) = 1. Consequently, the 
distribution function of X'l dt is continuous at 0, and hence, by (I3.9p . 



as n — 7- oo. 



Clearly, (13 .yp also holds, hence we obtain the statement in the case of (a, /3) G (0, 1)^. 

Next we consider the case of (a,/3) = (1,0). In this case equation (II. ip has the form 
Xk = Xk-i + Sk, k E N, and hence Xn = Ylk=i ^k, k E N. By the strong law of large 
numbers we have 



(3.10) n-'Xr, ^ /i„ 
and hence 

n — > /i^, 

where denotes almost sure convergence. Then n~^X^ 0, and hence, by Toeplitz 

theorem, we conclude 

n . 

(3.11) n-^J2^'k^U 



2 

fc=l 



Since /i^ > 0, this implies the existence of an event Qq E A such that P(fio) = 1, and for 
all u E Qq there exists an no(cj) G N such that X]fc=i ^^-2(1^)^ > for nQ{u). This 
is equivalent with IP(U^^i{Sfc=i ^1-2 > 0}) — 1' ^^^^ continuity of probability, is also 
equivalent with lim„_>.oo P({X]fc=i ^fc-2 0}) = 1. Clearly (13.71) also holds, hence we obtain 
the statement in case (a, /3) = (1,0). 

Finally, we consider the case (a,/3) = (0,1). In this case equation (11.11) has the form 
Xk = Xk-2 + £k, k E N, and hence X2n = YTk=i ^2fc, -^2n-i = Yl=i ^2k-i, n eN. By the 
strong law of large numbers we have 

n X2n > fie, n X2n~\ ^ /ie, 

which yield that 

(3.12) n^X^ ^ ^/x,. 
Using Toeplitz theorem, as in case (a,/3) = (1,0), we get 

(3.13) n^Y.Xl^\-^^l 

k=l 

One can finish the proof as in case (a, /3) = (1, 0). □ 
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The recursion ( I3.3P can also be written in the form 



(3.14) 



The representation (13.140 is called the canonical form of Sims, Stock and Watson [28], see also 

Hamilton [T^ 17.7.6]. A natural CLS estimator of the stability parameter q takes the form 

Qn[Xn) = an{Xn) + /3ri(X„), siucc, for cach n G N, a CLS estimator 

of {q, (3) based on a sample X„ = (Xi, . . . , X„) can be obtained by minimizing the sum of 

squares 



(3.15) 



k=l 



with respect to (f), (3) over M^. One can easily argue that any CLS estimator (^„, /3„) : M" — j- 
of (f?, /3) is of the form 



(3.16) 



QniXn) 




"l 


l" 




(^riiXri) 


f^n {Xn) 







1 







Xri. ^ 



where {an^ /3n) is a CLS estimator of (a, Namely, if i/j : ]R2 ^ ]R2 is a bijective measurable 
function such that 

3 {a',f3') ^^{a',f3') :-- 

with some function /i : — )■ M, then there is a bijection between the set of CLS estimators 
of the parameters (a,/?) and the set of CLS estimators of the parameters ■{/'(a,/?). Indeed, 
for all n e N, (xi, . . . , x^) G M" and (a', /?') G 









/i(a',/3') 




7'. 



fc=l fc=l 





T 




'a' 






P'. 







k=l 



Xk-2 



2 



hence (5?^, /3n) : — )■ is a CLS estimator of (a, /3) if and only if '^/'(q?^, /3n) is a CLS 



estimator of ip{a,P). With the special choice h : 



h{a,f3) := /3, (a,/3) G 



we 



get (13.161) . In what follows, by speaking about the CLS estimator ^„ of g we mean the 
first coordinate of ip{an,Pn)- Hence, by Proposition 13.11 the probability of the existence of a 
unique CLS estimator (fti(X„), /3„(X„)) converges to 1 as n — )■ oo, and this CLS estimator 
has the form 



(3.17) 
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on the set {u E Q : Y12=i -^^-2(1^)^ > 0}, where 

^k-i ~Xk-iVk-i 



E 

k=l 



k=l 



with 

























"1 1" 


f-'qu = i 


' 1 0" 




"1 1" 




" 1 0" 










F 












1 


-1 1 




1 




-1 1 



Vk-i := Xk-i - Xk-2, keN. 

In Appendix |Xl in Remark l9.2l one can find a detailed motivation of the definition of V^, A; G N. 
Indeed, by flXTjl . 



9n ~ ^n, 



which also shows that A^-^ exists on the set {w G : ^21=1 -^fe-2(i^)^ > 0}. 

Alternatively, the CLS estimator of the stability parameter g could also be 

obtained via a CLS estimator of {a,g). 

Note also that in case of an unstable INAR(2) process, i.e., when g = 1, we have 
(3.18) Vk = -PVu-i + Mfc + /i„ ke N, 

hence {Vkjkm is a stable AR(1) process with heteroscedastic innovations {Mkjkm and with 
positive drift /i^ whenever < /3 < 1. 



4 Proof of the main results 

In case of an unstable INAR(2) process, i.e., when g = a + [3 = l.hj fl3.17p . we have 



(4.1) 



gn{Xn) - 1 



n G N, 



on the set {uj eVL : XlILi -^^-2(1^)^ > 0}, where 

n 



k=l 



MkXk^i 
-MkVk-i 



n G M. 



Theorems 12.11 [2^ and 12.31 will follow from Theorems 14.11 and 14. 3[ respectively (see the 
details below). 



4.1 Theorem. Under the assumptions of Theorem \2.1\ we have 



(-^-n; dn) 





"^-3/2 


" 




" 









( 






An 









d^ 









n-^ 


1 



(A,d) 
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as n ^ oo, where 



A :-- 



lo^t'dt 

2/3 rl 



d :-- 



i§/;A',dt 

where {yVt)t&R+ '^''^d (yVt)teR+ o.^^^ independent standard Wiener processes. 
4.2 Theorem. Under the assumptions of Theorem \2.2\ we have 



{Am dn) 









Ar 



^-3/2 

n-V2 



n-3/2 




dr. 



d = U 



as n ^ oo, where 
A : = 

4.3 Theorem. Under the assumptions of Theorem \2.3\ we have 





"^-3/2 


" 




n-3/2 " 




n-3/2 " 


( 






An 


n-^ 




n^^ 










dr, 



(A,d) 



as n ^ oo, where 



A :-- 
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a', j; dt_ 



d:- 



where {Wt)t<m+ (iiT-d {yVt)t&R+ o,re independent standard Wiener processes. 

Now we briefly summarize how Theorem 14.11 yields Theorem I2.1[ The function g : 



p2x2 



»2xi ^ ^2x1^ defined by 



(4.2) 



'X^'y, if 3 X-\ 
0, otherwise, 



is continuous on the set {X E M^^^ : 3X ^} x M^^^, and the limit distribution in Theorem 



14.11 is concentrated on this set, since, by Remark 12.11 and the proof of Proposition 13.1 



Af/ dt > 



P 



Xfdt>0 



Hence the continuous mapping theorem (see, e.g.. Theorem 2.3 in van der Vaart |3j) yields 
that 

g{An, dn) g{A, d) 
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as 77, — oo. Under the conditions of Proposition 13.11 by (I4.ip . we have 



P 



( 


n 




Qn 




- I 




n^/\ 




Pn 







as n — )■ oo, where the invertabihty of A„ on the set {a; G : X]fc=i ^l-2('^)} follows by 
that of An. Clearly, if ?7„, n G N, and ^ are random variables such that S,n — > i as 
n — >■ oo and lim„_^oo IP(^n = fin) = 1, then ?7„ — Y ^ as n — )■ oo, see, e.g., Barczy et al. [3l 
Lemma 3.1]. Consequently, under the conditions of Theorem 12. H Theorem 14. II yields that 



where 



g[A, d) = A d 



n{gn{Xn) - 1) 
ni/2(3-„(X„,)-/3) 



i±^^ 



g{A, d) 



as n — )■ oo. 



2/3 J[^t_ 



^^-r^— -^/„' A'tdWt 



Hence we obtain (12. ip . and, using that XtdWt is symmetric, also the convergence of the 

second coordinate in (12. 2p . By Slutsky's lemma, convergence (12. ip implies nV2(^^(X„)-l) ^ 

p 

as well, where — > denotes convergence in probability, hence 



nV2(3-„(x„)-/3) 



n'/'iMXn) - 1) 



yields dM}. 

Next we briefly summarize how Theorem 14.21 yields Theorem 12.21 Similarly to the previous 
case, under the conditions of Proposition 13. H by (14. ip . we have 



P 





"^3/2 " 




Qn{Xn) - 1 


( 


r2i/2 
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[An, dn)] ^Flj2xt^>o] ^1 



as n — )■ 00. Consequently, under the conditions of Theorem 12.21 Theorem 14.21 yields that 

'n'/\UXn) - 1] 

where 



g{A, d) 



as n — 00, 



g{A, d)=A^d = -^ 



2Pe 3Pe 



AT 



0"; 



1^2 
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Hence we obtain (I2.6p . and convergence of the second coordinate in ( I2.7p . By Slutsky's lemma, 
convergence (12.61) implies ?t,^"(^„(JC„) — 1) — y as well, hence 



ni/2(S„(X„) - 1) 



n 



+ ni/2(^„(X„)-l) 



yields (EZD. 

Finally, we briefly summarize how Theorem 14.31 yields Theorem 12.31 Similarly as above, 
under the conditions of Proposition 13.11 by (14. ip . we have 



P 



^3/2 

n 



Qn{Xn) - 1 
^niXn) - 1 



g{A^, d„) j ^ P > Oj ^ 1 

as n oo. Consequently, under the conditions of Theorem 12.31 Theorem 14.31 yields that 

g[A, d) as n — )■ oo. 



n3/2(^„(x„,) - 1: 

- 1) 



where 



g[A, d) = A d 



12 
Mi 







1 



Me 



Since ^ /q tdWt is a normally distributed random variable with mean and with variance 



36(t2 /-i 12^2 



Jo 



we obtain (12.81) . and convergence of the second coordinate in (12.91) . By Slutsky's lemma, 
convergence (12.81) implies n(ft^(X„) — 1) — )■ as well, hence 



n(3n(X„) - 1) 



n(/3„(X„) - i: 



+ n{gn{Xn) - 1) 



yields 



5 Proof of Theorem 4.1 



We have 

(5.1) (i,.,a. 



E 

,fc=i 



fc-1 



-n 



n 



-2y2 



E 

k=l 
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5.1 Lemma. Under the assumptions of Theorem \2.1\ we have 

n 

(5.2) n-5/2^X^y^^0 



as n ^ oo, 

k=l 



n 

as n ^ oo. 



(5.3) ""ME'^-^-lfs^:-^'- 
Proof. We have 

n n n n n n 

fc=l fe=l k=l k=l k=l k=l 



— 2 Xfc(Xfc — Xfc_i) — X^, 

/c=l 

thus 

(5.4) E^^^^ = ^^n + ^E^'='^0- 



2 " 2 

fe=l k=l 



Corollary 19.11 implies 



/ n \ n 

E 5^ X,\4 = - E(X^) + - ^ E(lf ) = 0(n2), 

\fc=l / k=l 

hence we obtain (15. 2p . 

In order to prove (15. 3p we derive a decomposition of Y12=i '^k ^ ^ martingale 

and some negligible terms. Using recursion (13.181) and Lemma 19. H we obtain 

I ^k-i) = E {{-l3Vk-i + Mfc + /i,)2 I 

= P^Vl, - 2f3fiM-i + E(M2 I J-,_i) 
= /3V,2_i - 2/3/i,V^,_i + /i^ + a/3(Xfc_i + X^.a) + a,^ 
= /3V,2_i + 2a/3Xfe_i + /i^ + a? - (2/3/^^ + a/3)^fc-i 
= /3^V^^_i + 2a/3Xfc_i + constant + constant x Vk-i, 
where we used that Xfc_i + Xfc_2 = 2Xfc„i — Vfc_i, A; G N. Thus 

n n n 

A;=l A;=l k=l 

n n n n 

= E [Vk - E(Vf I J-fc_i)] + E ^fc-i + E ^^-1 + O(^) + constant x E ^fc-i- 

fc=l k=l k=l k=l 
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Consequently, 



(5.5) 



n ^ n OR 

fc=l '"^ fc=l ^ k=l 



/3 



1-/3^ 



+ 0{n) + constant x Vj, 



fe=i 



By the tower rule of conditional expectation, — IE(V;? | J^k-i) and V^^ — IE(V^/ | ^^-i) are 
uncorrected if k ^ so 

where we also used Corollary 19.11 and 




n n 



A;=l 



fc=l 



(5.6) E ( - E(e I ^)] ) = - E (E(e I -F)2) ^ E(e^) 

for an arbitrary random variable ^ with E(^^) < oo and a-algebra T d A. Hence 

1 " 

- ^ [V;2 - ^{Vl I J-,_i)] A as n ^ oo. 



fc=i 



Again, by Corollary 19.11 we obtain E(y^) = 0(?7,) and E(X^_]^) = 0(r;,^), and since 

Vk-i = Xn-i, n G N, we get n~'^Vj^ and X]fc=i -—^ as n — )■ oo (we 
note that the second convergence follows also by (I9.14p with the choices £ = S, i = 0, j = 1). 
Consequently, by (15. 5p . we obtain (15. 3p . □ 

Now let 

Uk := Xk + /3Xfc_i, k e Z+, 

with the convention f/_i := Uq := 0. In Appendix lAl in Remark 19.21 one can find a detailed 
motivation of the definition of Uk, k ^N. One can observe that Uk ^ for all k G Z_|_, and, 
by a + f3 = 1, 

(5.7) ?7fc = t/fc_i + A4 + /i., ke Z+, 

hence {Uk)k&+ is a nonnegative unstable AR(1) process with positive drift /i^ sharing the 
innovation {Mk)km with the AR(1) process {yk)k&+- 

Consider the sequence of stochastic processes 



M 



in) 



AT/") 



(n) 



\nt\ 



(n) 



with 



k=l 



n-^Mk 
n-^MkUk^i 



t G 



k,n eN. 



Theorem 14.11 will follow from Lemma 15.11 and the following theorem (which will be detailed 
after Theorem 15. ip . 
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5.1 Theorem. Under the assumptions of Theorem \2.1\ we have 

(5.8) ^ Z as n^oo, 

where the process {Zt)tm+ ''^'^th values in is the unique strong solution of the SDE 

(5.9) d.Zt = 7(t, Si) dWt, teM+, 



with initial value Zq = 0, where Wt := 
standard Wiener process), and 7 : M+ x — )■ 



Wi Wt 

3x2 



, t E M+ (being a two-dimensional 
is defined by 



^[(a;i+^,t)+]V2 
y%[(x,+/i,t)+]3/2 

{Xl + fist) 

for t e M+ and a; = (xi, X2, X3) € M^. 



Indeed, the unique strong solution of (15. 9p with initial value Zq = can be written in 
form 



'Mt 




(1 + l3)Xt - 




Aft 






te 


_Vt_ 




Jo ^■^ ^'^'^■5 





since, by Remark 12.21 





'dMt 




dZt = 


dM 











(3g^(M + /i.t)d>V, 



^^Xl'^ dWt 

.3/2 



v/2^(l + (3)Xr dWt 



^^,Xt dWt 



By the method of the proof of X^'^^ — )■ X in Theorem 3.1 in Barczy et al. |1] one can easily 
derive 



(5.10) 

More precisely, using that 





C ^ 


'x 






z 



as n — )■ 00. 



Xfc = ^(M,+//,)e7A'=-^ei, 



A; G N, where Ci : = 



see, e.g., Barczy et al. [H (3.11)], we have 



^„(S('^)), n G N, 
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where the mapping ?/;„:□( 



MfiJ2j3m :-- 



^ D(M+, M^) is given by 

hit) 

f2{t) 

hit) 



for /i, /s, /s e D(M+, M), t G M+, n G N. Further, using that, by Remark E2l 

1 



1 + /3 



(Mt + flet), tGM+, 



we have 



where the mapping ^^ : D( 



Z 



^+1 ■ 



D( 



^(/i,/2,/3)(t) : = 



^) is given by 

/2(t) 
hit) 



for fi, h^ h £ D(M+,]R) and t G M+. By page 603 in Barczy et al. [1], the mappings ipn, 
n G N, and -j/^ are measurable (the latter one is continuous too), since the coordinate functions 
are measurable. Using page 604 in Barczy et al. we get the set 

C := {/ G C(M+,M3) : /(O) = G M^} 

has the properties C C C^,(^„)„g^ with C G i3(D(M+,M3)) and F{Z e C) = 1, where 
Cv,(V'n)„eN is defined in Appendix El Hence, by ( 15. 8p and Lemma iB. 21 we have 



_2(n) 



z 



as n — )■ oo, 



as desired. Next, similarly to the proof of fl3.9p . by Lemma [B. 3 [ convergence (15.101) implies 



E 

k=\ 



/o dt 



:i + /3)v^/o A'r dw, 



as n — )■ cxD. 



Using ?7fc_i = (1 + /3)Xjfc_i — fSV^^i and convergence of the third coordinates in Z^"'^ 



we obtain 

-2 



n 



\fc=i ' ' k=i / \ ' 







as n — )■ oo. 



Using (15. ip . the above two convergences and Lemma [5.11 we obtain Theorem 14.11 by Slutsky's 
lemma. 
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6 Proof of Theorem 



5.1 



In order to show convergence ^'■"^ we apply Theorem IC.ll with the special choices 



U := U 



(n) 



'k 1 



/c G N, (J^fc"^)fc6Z+ := {^k)k&+ and the function 7 which i 
defined in Theorem 15.11 Note that the arguments in Section [5] and Remark 12.11 show that the 
SDE ([53]) admits a unique strong solution for all initial values Zq — 2 G M'^. 

Now we show that conditions (i) and (ii) of Theorem IC.ll hold. The conditional variances 
have the form 



IS 



for n G M, /c G {1, . . . , n}, and 
















for s G IR+, where we used that [M^^^ + yUes)"*" = A^i"^ + /igS, s G IR+, G N, see Barczy 
et al. [U page 598] or (16.71) later on. In order to check condition (i) of Theorem IC.ll we need 
to prove that for each T > 0, 



(6.1) 
(6.2) 
(6.3) 
(6.4) 
(6.5) 
(6.6) 



sup 

te[o,T] 



sup 

tG[0,T] 



sup 

ie[o,T] 



sup 

ie[o,r] 



^ 1 + P Jo 

-^f/,_iE(M,2|J-,_0-^ / (M"^+/x,.)M. 
^ fc=i i + PJo 

^ k=l ^+PJo 

^ [nt\ 

-Y.V.'.MMllJ'k-i) 



0, 



n 



k=l 



sup 

te[o,T] 



n 



\nt\ 



sup 

ie[o,r] 



fc=i 

\nt\ 



0, 



^,Y.Uk-,v,.,nMl\:F,^{, 



k=l 







as n — > 00. Covergence (16. ip follows from (5.1) in Barczy et al. [1] with the special choices 
p = 2, ai = a and 02 = (3. 
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Next we turn to prove (16. 2p . Since a + (3 = 1, by (I3.2p . we get 

lns\ 



(6.7) 



k=l 



1, X — [nsj 1 ns — [ns\ 

— (^InsJ +P^lnsJ-l) H ^£ = — tVlnsJ H /^e 

n n n 



for s e M+, n e N. Thus 



\nt\-l 



\nt\-l 



•^^ k=l k=l 



+ + /^e- 



Since 
(6.8) 



1 + 

using Lemma [9.11 we obtain 



1 + /3 



[nt] [nt\ 

J2 Uk-i E(M2 I J-,_i) = ^ f/fc_i [aP{Xk_i + Xfc_2) + 

k=l 



k=l 



(6.9) 



k=l 



k=l 



k=l 



k=l 



Thus, in order to show (16.21) . it suffices to prove 



(6.10) 

(6.11) 

(6.12) 
(6.13) 



k=l 



n 



[nT] 
k=l 



n sup Uint\ — > 0, 

tG[0,T] 

n"^ sup [[nt\ + {nt - [nt\f] 

tG[0,T] 



as n — cx). Using f l9.14p with £ = 8, i = 1, j = 1 and i = 8, i = 1, j = 0, we have (16.101) 
and dnHD, respectively. Using (l9J[5|) with i = 8, i = IJ = 0, we have (l67[2D . Clearly, (l67[3D 
follows from |?T,t — [ntj | ^ 1, ?i G N, t G IR+, thus we conclude (16. 2p . 
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Now we turn to check (16. 3p . Again by (I6.7p . we have 

"'^ k=l k=l k=l 



nt — Ynt\ 



\nt\ 



+ 



3/i,(nt - [ntj )%,2 , ^^l{nt - [nt\ , [^tj + {nt - [nt\ Y ^ , 



2n^ 



4n4 



Using Lemma I9.H we obtain 

[nt\ 
k=l 



[nt\ 



k=i 



[nt\ 



k=l 



a(3 
1 + 



lnt\ 



^ k=l k=l k=l 



lnt\ 



lnt\ 



Thus, in order to show (16.31) . it suffices to prove 

[nT\ 



(6.14) 
(6.15) 

(6.16) 

(6.17) 
(6.18) 



n 



E \u'kVk 

k=l 
[nT] 

k=l 
LnTJ 

k=l 



n 



n sup U\nt\ — > 0, 
te[o,T] 

n-^ sup [[nt\ + {nt - [nt\Y] 
te[o,T] 



as n oo. Using (l9:i4l) with £ = 8, i = 2, j = 1, £ = 8, i = 2, j = 0, and £ = 8, i = 1, 
j = 0, we have (Kl^ . ( l635|) and (l6A6|) . respectively. Using (l9A5|) with £ = 8, i = 1, j = 0, 
we have fl6.17p . Clearly, ( I6.18P follows again from \nt — [nt\ | ^ 1, n G N, t e M_|_, thus we 
conclude (16. 3p . 

Next we turn to prove ([63D- By ([63]), fl6:T0|) and ( 16TT]) we get 



(6.19) 



n sup 

te[o,r] 



[nt\ 



2a(3 



lnt\ 



J:u,^,e{m!\:f,^,)-^J2uI, 



k=l 



k=l 



as n — )■ oo 
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for all T > 0. Using f l6.2p . in order to prove ( ]6.4p . it is sufficient to show that 



(6.20) 



n sup 

te[o,T] 



lnt\ 
k=l 



[ntj 



fc=i 



as n — )■ oo 



for all T > 0. As in the previous case, using Lemma l9TT] and ( 16. Sp . we obtain 

[nt] [nt] 



fc=l 



fe=l 



[nt] 
k=l 



af3 
1 + /3 



[nt] 



fc=l ^ fe=l fc=l 

Using fl97H|) with £ = 8, i = 0, j = 3 and £ = 8, i = 0, j = 2, we have 

[uTi 



[nt\ 



[nt\ 



n 



k=l 

hence fl6.20p will follow from 
(6.21) 



0, 



[nT\ 
k=l 



as n — )■ oo, 



n sup 

te[o,T] 



lnt\ 
k=l 



2(3 



lnt\ 



k=l 



as n — i> oo 



for all T > 0. 

The aim of the following discussion is to decompose Uk—iV^_i — 2/3[l-\- /3) ^ ^i=i ^k—i 

as a sum of a martingale and some negligible terms. Using recursions f l3.18p . fl5.7p and Lemma 
19.11 (formula fl9.ip ). we obtain 

E(t/fc_ilf_i I = E ((f/fc_2 + Mk-1 + fle){-m~2 + Mfe„i + I J-fc„2) 

= f3'Uk^2Vl, + af3{Xk^2 + Xk-3){Uk^2 - 2/3y,_2 + 3/i.) + E(Mti | J-,_2) 
+ constant + linear combination of Uk-2Vk-2, V'^^-2) Uk-2 and Vk-2- 
Using again Lemma [9.11 (formula (19. 3p ) and (16.80 . we get 



(6.22) 



/32f/fc_2\4'_2 + Y^(2f/fc„2 - aV^fe-2)(t/fc-2 - 2/3\4_2 + 3/i,) + E(AC^ | j-,^^) 
+ constant + linear combination of ?7i._9Vfr_9, V^^ o, t/i--9 and Vj 



fc-2V'fc-2, ^^-25 '^A;-2 

P^Uk-2V^_2 + Y^U^^2 + constant 

+ linear combination of Uk-2Vk-2, Vk-2^ Uk-2 and Vk-2- 



'k-2 
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Thus 



lnt\ [nij [nt\ 



k=l 



k=2 



k=2 



[ntj 



lnt\ 



2a/3 



fe=2 fc=2 ^ fc=2 



fc-2 



lnt\ 



lnt\ 



lnt\ 



lnt\ 



+ 0(n) + linear combination of ^^[/fc-2Vfc_2, '^^^^-2^ ^fc-2 and V^. 



k=2 



k=2 



k=2 



Consequently. 

[nt\ 



lnt\ lnt\ 
k=l ^ k=2 



0- 



2al3 



k=2 



lnt\ 
k=2 



[nt] [nt] [nt] [ntj 

+ linear combination of ^^f/fc_2Vfc_2, ^Af-2; f^fc-2 and I 
Using fl9.16p with i = 8, i = 1 and j = 2 we have 



77, sup 

te[o,T] 



[nt\ 



Y [Uk-ivi, - nuk-ivi, I Tk^2 



k=2 



as n — 7- oo. 



Thus, in order to show (16.211) . it suffices to prove 

[nT] 



(6.23) 

(6.24) 

(6.25) 

(6.26) 
(6.27) 
(6.28) 



n 



n 



J2 - 

k=l 

\nT\ 



k=l 
[nT] 

k=l 

[nT] 



n 7 uk 

k=l 



n 



VnT\ 

E °. 

k=l 



n sup U\nt\V\^t\ — > 0, 

t6[0,T] 

^ sup U\^^ > 

t6[0,T] 



25 



as oo. Using with £ = 8, z = 1, j = 1; i = 8, i = 0, j = 2; £ = 8, i = 1, j = 0, 

and i = 8,i = 0, j = 1, we have (K^ . (K^ . (K^ and (Km> . Using (TOf^ with £ = 8, 
i = 1, J = 2 and ^ = 8, i = 2, j = 0, we have (KTHf and Thus we conclude flO]) . 

For f l6.5p . consider 



k=l 
[nt] 



k=l 



2a(3 ^^^2 , 2 

1 + 



[ntj 



^ k=l ' k=l k=l 



where we used Lemma [9. II and (16. 8p . Using (19.141) with £ = 8, i = 0, j = 2, and £ = 8, z = 0, 
j = 1, we have 



LnTJ 



\nT\ 



n 



-5/2 



^ A 0, ^ l^fcl A as n ^ 00, 



fc=i 



fc=i 



hence (16. 5p will follow from 
(6.29) 



n ^^'^ sup 

t6[0,T] 



Y,Uk-iVk- 

k=l 



0. 



The aim of the following discussion is to decompose Uk-iVk-i as a sum of a martingale 

and some negligible terms. Using the recursions (I3.18p . (15. 7p and Lemma [9.11 we obtain 

E(f/fc-lVfc_i I J-fc_2) = E ((f/fc_2 + Mk-l + /i,)(-/3\4_2 + Mfc_i + lie) I J'fc_2) 



-/3t/fc_2V^fe-2 + ^^eUk-2 - (3l^eVk-2 + /i' + HM^l I 



'k^2) 



—j3Uk-2Vk-2 + constant + linear combination of Uk-2 and Vk-2- 



Thus 



[ntj 



Uk^iVk-i = [Uk-iVk-i - E{Uk-iVk-i I J-fc_2)] + Yl HUk-iVk-i I J-fc-2) 



A;=l 



k=2 



[nt\ 



k=2 



[nt\ 



Y [Uk-iVk-i - HUk-iVk-i I ^fc-2)] -PY Uk-2Vk-2 



k=2 



k=2 



\nt\ \nt\ 

+ 0(n) + linear combination of 'Y^ Uk-2 and 'Y^ Vk-2- 

k=2 k=2 
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Consequently 



\nt\ 



k-1 



k=2 



1 B 

^ " k=2 ^ 

[ntj [nt] 

+ 0(n) + linear combination of Uk-2 and Va;_2. 



k=2 



k=2 



Using fl9.16p with £ = 8, i = 1 and j = 1 we have 



n sup 

t6[0,T] 



[ntJ 



k=2 



as n — > oo. 



Thus, in order to show (16.291) . it suffices to prove 

\nT\ 

fc=i 

LnTJ 



(6.30) 

(6.31) 
(6.32) 



n 



-5/2 



-5/2 



E i^'i ^ 0. 



fc=i 



n -'- sup 

t6[0,T] 







as n ^ oo. Using fITOD with ^ = 8, z = 1, j = 0, and ^ = 8, z = 0, j = 1, we have flCTD 
and fl6.3ip . Using (19.151) with £ = 8, z = 1, j = 1 we have (16.321) . thus we conclude (16. 5p . 

Convergence (16. 6p can be handled in the same way as (16.51) . For completeness we present 
all of the details. By Lemma [9.11 and (16. 8p . we have 

\nt\ \nt\ 

Y Uk^iVk^i I J-fe-i) = Y Uk^i^k^i («/3(Xfc_i + Xfe_2) + al) 

k=l 



k=l 



^ k=l ^ k=l k=l 

Using (I9.14P with £ = 8, i = 1, j = 2, and i = 8, i = 1, j = 1, we have 



LnTJ 



LnTJ 



n 



-7/2 



n 



-7/2 



^[/fc_i|Vfe„i| — ^0 as n cx), 



k=l 



k=l 



hence (16. 6p will follow from 
(6.33) 



n '^/^ sup 

i6[0,T] 



[nt] 

YUk-iVk^i 

k=l 



as n — )■ cxD. 
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The aim of the following discussion is to decompose X]i=*i ^l-i^fc-i as a sum of a martingale 
and some negligible terms. Using the recursions fl3.18p and (15. 7p . we obtain 

Hence, by Lemma WA\ and (16.81) . 

E(t/fc_iVfc_i I J'fc-s) = -/3f/fc_2Vfc-2 + constant 



+ linear combination of t/fc-25 ^fc-25 ^fc-25 ^^'^ f^fc-2Vfc-2- 



Thus 



[ntj \nt\ [nt\ 

J2 uLiVk-i = Pk-iVk-1 - mLiVk-i I J'k-2)] + 5^ E(f/tiy,_i I j-,_2) 

fc=l fc=2 



fc=2 



5^ - E(f/|„i\4-i I J-,.„2)] - /3 J] t/L2^fc-2 + 0(n) 

fc=2 



fc=2 



[ntj [ntj [ntj [nij [ntj 

+ linear combination of ^ t/fc-2, ^ Vfc_2, ^ t/fe„2, ^ ^^^^-2 and ^ f/fc_2Vfc_2- 



A;=l 



fc=i 



fc=i 



k=l 



k=l 



Consequently 

[nt\ 



[nt\ [nt\ 

J2 uUVk-i = -— Yl [uLiVk-i - mliVk^i I J'k-2)] + -^t/LLj.iHnij-i 

k=l ^ fc=2 ^ 

[nt] [nt] [nt] [nt] [nt] 

+ 0(n) + linear combination of ^ ?7a:-2, ^ Vfc_2, ^ ^fc-2' ^fc-2 'Y ^k-2Vk-2- 



k=l k=l k=l 

Using (I9.16P with £ = 8, i = 2 and j = I we have 



k=l 



k=l 



n sup 

te[o,r] 



[nt\ 



fe=2 



as n — )■ 00. 



Thus, in order to show (16.331) . it suffices to prove 

LnTJ 



(6.34) 
(6.35) 



n 



k=l 
LnTJ 



LnTJ 
-7/2 X- ,;2 

k=l 
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\nT\ 



(6.36) 

(6.37) 

(6.38) 
(6.39) 



n 



n 



-7/2 



E i^-'i ^ 0. 



k=l 
\nT\ 



-7/2 



fc=l 
LnTJ 



n 



-7/2 



k=l 



n'l^ sup |f/2 y^nd^O 

te[o,T] 



as n cx). Here flCTj) . (lOSj) . (l636|) . (lOTj) and f l638|) follow by ( imj) . and (ICTD by (I9J^ . 
thus we conclude (16.60 . 

Finally, we check condition (ii) of Theorem IC.lt i.e., the conditional Lindeberg condition 



LnTJ 



(6.40) 5^E(||zi")fl^ 



{||Z(")||>0} 



J^fc-i) ^ for all ^ > and T > 0. 



fc=i 



We have E f llzl^^fl 



{Il4"'ll>^^} 



^r^Edlzl^^n and 



Hence 



LnTJ 

J^E (||z["^f ^ as n^oo for all ^>0 and T > 0, 

fc=i ^ 



since E(M,4) = 0(A;2), E(M,4f/tJ ^ JE(M|)E(f/tJ = 0(A;6) and E(M,V,1J ^ 



E(M|) E(V^^_j^) = 0(A;'^) by Corollary 19.11 Here we call the attention that our eight or- 
der moment condition E(£:^) < oo is used for applying Corollary 19.11 This yields fl6.40p . 



7 Proof of Theorem 14.2 



We have 



d^) 



E 

,fc=i 



A,-=l 



Theorem 14.21 will follow from the following statement (using also Slutsky's lemma). 
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7.1 Theorem. Under the assumptions of Theorem \2.2\ we have 



n 



"2 



fc=l 



fc=l 



fc=l 



E 

fc=i 



AT 



1^2 _1m2 

3^e 



Proof. In this case equation (11. ip has the form Xk = Xk-i + Ek, k E N, and hence 
Xk = Ei^ \-ek, Mk = Xk- Xk-i - /ie = Ek - Us and Vk = Xk - Xk-i = Sk, k e N. 

We have aheady shown the first statement, see ( 13.1ip . By the strong law of large numbers 
we have 



n 



' jJil as n — cx). 



fc=i 



k=l 



(7.1) 

Moreover, 

n 

Y,Xk-iVk-i = Y.Xk 



fc-2 



fc=l 



fc=l 



A;=l 



fc=l 



fe=l 



k=l i=l 



k=l l^t<jXn-l 

with Eq := 0, and hence by (I3.1UI) and fl7.ip . 



(7.2) 



n 



vfc=l 



k=l 



k-1 



k=l 



The last statement can be proved by the multidimensional martingale central limit theorem 
(see, e.g., Jacod and Shiryaev [T71 Chapter VIII, Theorem 3.33]) for the sequence {Y^f^\ J^k)keN, 
n e N, of square-integrable martingale differences given by 



n-^/'MkXk-i 
-n'^'^MkVk^i 



n-y^i6k-fXe)X, 



-1/2 



n,k eN. 



We have 



E{Yt\Y^^^y\^k-,) = a, 



n ^'^[Ek - IJ^e)£k-l 



n 3X|„i -n ^Xk-iEk-i 
-n-'^Xk^iEk^i n-^^l^i 



n,k eN, 



hence by (13. lip . (17. ip . and (I7.2p . we have the asymptotic covariance matrix 



k=l 



3 2 



30 



The conditional Lindeberg condition 

n 

j2E{\\Y^^ri 

k=l 

is satisfied for all 9 > 0, since using that E{sf) < oo, 

n 1 " 



k=l 



k=l 



A:=l 



9^ 



k=l 



as n — )■ OO, where the last step follows by lE(X^) = 0{k^) (see Corollary 19. ip . 



8 Proof of Theorem 14.3 



,k=l 



-n 



We have 

-n-'/^Xk-iVk-i n-^Vl, 
8.1 Lemma. Under the assumptions of Theorem \2.3[ as n ^ oo, we have 

,2 



k=l 



-n~^MkVk-i 



(8.1) 
(8.2) 
(8.3) 
(8.4) 
(8.5) 
(8.6) 



n 



n 



n 



n 



3 \^ v2 a.s.^ 

fc=i 

n 

-'/'Y.^k-iV,.,^0 

k=l 

n 

^[E(\4_i)]'->0, 

k=l 

n 

J](V^fc_i-E(14_i))E(y, 



0, 



k=l 



-3/2 



^Mfc(Xfc_i-E(Xfc_i)) ^0, 



k=l 



n 



-^Y,^knvk-i)^^. 



k=l 
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Proof. In this case equation (ll.ip has the form Xk = Xk-2 + ^ki k E N, and hence 

= £2 + £4 + ■ 1- £2k, = Bi + 63 + ■ ■ ■ + e2k-li Mk = Xk — Xfe_2 — f^e = ^k — /^e and 

y2k = ^2fc — X2k~l = (^2 — £^1) H ■ + (^2fc — ^2A:-l), ^2fc-l = -^2A;-1 — -^2fc-2 = (^1 — £^2) H ' + 

(e2fc-3 -£^2fe-2) +£2fc-l, ken. 

We have aheady shown (18.11) . see (13.131) . 

In order to show (18.21) . we use (15. 4p . Clearly we have 



/ n \ n 

^[Y.XkVk] = ^ ml) + m^) = o{n' 

\k=l / k=l 



since, by Corollary EJl lE(X^) = 0{n'^), n e N, and E{V^) = 0{k), k e N, and hence we 
obtain (18. 2p . For each A; G N we have K{V2k) = and K{V2k-i) = /^e, hence we conclude 
dHSD, and 



E 



Y,iVk^i-HVk^i))HVk-i] 



k=l 



Y,t^emVk-l-E{Vk-i)\) 



k=l 
n 



^ J2f^eJmVk-i-nVk-iW) = 0(n3/2), 



k=l 



since E(Vfc - E{Vk)f ^ E{V^) = 0{k), keN (by Corollary EI]) , which implies 
Moreover, using that Mk{Xk-i — E(Xfc_i)), k = 1, . . . ,n, are uncorrelated, 

EUY^Mki^k-i-nXk-i))] I =f^E((£fc-/x,)2(Xfc_i-E(X,_i))' 



n 

(7,2 5^E -E(X,_i))') = 0(n2 



fc=i 



since E{Xk-i - E{Xk-i)Y ^ E(X^_J = 0(A;), A; e N (by Corollary EI]) , thus we get (l83il . 
Since E(V2fc) = and E(V2fc-i) = fie, k e N, we have 



E ^M,E(y,_i) =5^[E(V^,_i)]'E((efc-/i,)2) =a,2^[E(V^,_i)]' = 0(n), 

y \fc=l / J k=l k=l 

which implies (18. 6p . □ 

Theorem 14.31 will follow from Lemma 18.11 and the following statement (using Slutsky's 
lemma) . 

8.1 Theorem. Under the assumptions of Theorem \2.3\ we have 



E 

k=l 



n 



'{Vk^i-E{Vk^{))' 



n-^I^MkE{Xk-i) 
-n-^Mk{Vk^i-E{Vk^i)) 



lfie(TeJotdWt 



as n — )■ oo, 
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where (Wt)jeM^ and {yVt)tm+ independent standard Wiener processes 
Proof. Consider the sequence 



t 

^(n) 



n 



t e 



n e N, 



^^"^ {X2[nt\-1 —^{X2[nt\-l)) _ 

of stochastic processes. Then, by the multidimensional martingale central limit theorem, 



n 



1.7) 



-y-(n) 



as n — )■ 00, 



where (-Bt)teR_,_ and {Bt)t£R+ are independent standard Wiener processes. Indeed, with the 
notation 



-in) 



n,k eN, 



we have that {Y^^\ T2k)ken, n G N, is a sequence of square integrable martingale differences 
such that 



lnt\ 
k=l 



t 

in) 



n e N, t e 



E (ri"^ I J'2(fc-i)) = G and 

E I J-2(,_i)) = a,2n-^/2, n, e N, 

where I2 denotes the 2x2 identity matrix. Then the asymptotic covariance matrix 



lnt\ 



J2^{YP{YPy I J-2(fc„i)) ^ a'^tl2 as n ^ 00 for t e 



fc=i 



The conditional Lindeberg condition 

[nt\ 



XI ^ (ll^fe"^ll^^{|iyi"'||>e} 1-^2(^-1)) ^0 asn^cx) 



is satisfied for all t G M_|_ and 9 > 0. Indeed, we have 



[ntj 



J^Edl^r^fl 



k=l 



{||^^i"'ll>f}) 



1 / 

- X E ((e2fc - f^ef + {£2k~l - f^e?) 1 
^ k=l 



n 



^0, 
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by dominated convergence theorem. This yields that the convergence in (18.8P holds in fact in 
Li-sense. Thus we obtain (18. 7p . We are going to prove that convergence (18.71) implies 



(8.9) E 



k=l 



n 



-n-^Mu{Vu-i-nVk-i)) 



as n — > oo, which yields the statement. Indeed, {2"^/^{Bt + Bt)) and {2~^/^{Bt-Bt)) 



are independent standard Wiener processes, and by Ito's formula, t dWt = Wi - Wt dt 
and /o Wt dWt = 2-i(>Vf-l), which yield the statement with the choices Wt := 2-^/^{Bt+Bt), 
t ^ 0, and Wt := 2-^/^{Bt -Bt),t^O. 



Applying Lemmas IB. 21 and IB. 31 as in the proof of Proposition 13. II and using Slutsky's lemma, 
(18.91) will follow from 

fc=l k=l 
fc=l ^ A;=l ^ 



fc=l 
1 

n 



(8.12) - J2 My^-^ - nVk-.)) + J - rl^'^^f - 2a\ 



k=l 



0. 



Indeed, first considering the subsequence {2n)n&h let us apply Lemmas IB. 21 and IB. 31 with the 
special choices d := 2, p := 2, q := 2, /i : M^, 



/i(xi, X2) := ( xi + X2, ^(xi - X2)^ ~ ^ ) ' (^1' ^2) e ™^ 



: [0, 1] X 



and 



Then 



K{s, xi, X2, X3, X4) := ( - a;2)^ xi + X2 



U := a. 



'b 


W^") := 






7-(n) 


B 





(s,Xi,X2,X3,X4) G [0, 1] X 



n e N. 



11^(3, xi,X2,X3,X4) - K{t,yi,y2,y3,y4)\\ 



{{xi - - {yi - y2YY + {xi -yi+X2- 2/2) 



1/2 
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^{xi -yi + y2- X2f{xi -X2 + yi- 1/2)^ + (a^i -yi + X2- y2f 



1/2 



^ 2 (((xi - y,f + {y2 - X2)^) ((xi - X2f + (yi - ^2)') + ((xi - yi)^ + (x2 - 1/2)'))'^' 

^ 8i?||(a;i,a;2,X3,X4) - (2/1,2/2,^3,2/4)11 

for all s,tG[0,l] and (xi, 2:2, X3, X4), (2/1, 2/2, 2/3, 2/4) G I^"^ with || (xi, X2, X3, X4)|| ^ i? and 
11(2/1,2/2,2/3,2/4)11 ^ i?, where i? > 0, since 

(xi - X2)' + (2/1 - 2/2)' ^ 2(x? + x^) + 2{yl + 2/2') ^ 8i?2. 

Further, using the definitions of $ and $„, G N, given in Lemma [B. 3 1 we have 



7-{«) 



' n ^ 2 ' n ^ fe/" '^■/"'' I 

A:=l fc=l / 



and 



a,(i3i + Si), ^(i3i - i3i)^ - ^, / ^(H, - BuY dM, / a,(i5„ + E^) dw ) . 



2 /•! ^2 



Since the process 0"e[i3t -BtJ^jj^ admits continuous paths with probability one, (18. 7p . Lemma 
El (with the choice C := C(R+, M^))^ and Lemma ED yield that 



-y-(n) 



as n — >■ 00. 



By another easy application of continuous mapping theorem (formerly one can again refer to 
Lemmas IB. 21 and IB.3P we have 



J_ v^n / qin) _ q-{n)-.2 
2n l^k=l\'^k/n 'k/n! 
qH I q-in) _ I s-^n /<-{■«) I -^-(n)^ 
'^1 '1 „ Z^fc=ll^fc/„, "T /fc/n^ 



--l((B,-B,Y-2 



as n — !■ 00. 



Hence, using fl8.10p . (18. lip . (I8.12p . and Slutsky's lemma, we have (18. 9p for the subsequence 
(2n)„gN. To prove (18. 9 p for the subsequence (2n— l)neN, by Slutsky's lemma, it is enough to 
check that 

^.(K-E(K))'-^o, 



(8.13) 
(8.14) 
(8.15) 



n 



3/2 



M„E(X„_ 



0, 



-M„(V;_i-E(K-i)) ^0. 
n 
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By Corollary EH E((V; - = 0(n), 

E(|M„E(X„_i)|) =E(|M„|)E(X„„i) =E(|£i -/i,|)E(X„„i) = 0{n), 

and 

E(M2(K-i - E(K-i))2) = E ((K-i - E(K-i))2 E(M2 I J-„„i)) 

= E((V;_i - E(V;_i))2) = 0(n), 

thus we obtain (Km . fISll) . and fl8J[5D . 

First we will prove (18.101) . (18. lip and (I8.12p for the subsequence (2?7,)„gN and then the 
subsequence (2n — l)„,gN- In order to prove (I8.10p first observe that, for all k eN, 

An) _ q-in 



V2k - E(\/2.) = [X^k - E(X2,)) - (X2fc_i - E(X2,_i)) = n^l\stl - 



Then 

2n ^ n— 1 



^ k=l k=l k=l 

^ n—l ^ n 

k=l k=l 

n 

- ^ l^y^k/n - 'k/J - -^y^l - 1 1 ) 

k=l 

^ n 1 " 

fe=l fc=l 
1 " 1 



fc=l 

n 



fc=l k=l 



Thus, in order to prove (I8.10p for the subsequence (2n)„gN, it suffices to prove 

(8.16) ^(^2n-E(r2n))'^0, 

1 " 

(8.17) - 5^(£2fc - /ie)(^2fc - nV2k)) 0, 

fc=i 



1 " 

U8) 



k=l 



^ 
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as n ^ cx). By Corollary EH we have E{{V2n - E{V2n))^) = 0{n) and E{{e2k - l^e^) = cr^ 
thus we obtain dHU and ^M- Further, - E{V2k) = (^2^ - /ij - (^2fc-i - E(V^2fc-i)), 
hence (18.171) follows from (I8.18P and from 



= J] E ((V^2fc-i - E(^fc-i))') = 0( 

k=l 

and we finish the proof of (18.101) for the subsequence (2r2)„gN. 

Now we turn to prove (18.111) for the subsequence (2n)„gN. First observe that 

2n n—1 n 

Mk E(Xfc_i) = fie y^(£2fc+l - fie)k + /i£ ^{£2k - ^'e)k. 
k=l k=l k=l 

We have 

n n k n n n / n j—1 

k=l k=l j=l j=l k=j j=l \k=l k=l 



n 

An) 

'(j-l)/n' 

i=i j=i 



X [(^2n - E(X2„,)) - (X2,„2 - E(X2,_2))] = u'^'S^^^ - U^'^ ^ 4 



and, in a similar way, 

1 n—1 k n—1 n—1 

X(^2fc+1 - = X X*^^2fc+1 - /^e) = X X*^^2fc+1 " /^e) 

fc=l fc=l i=l j=l A:=j 

n—1 / n—l j — l 

= X I X'^^^fc+l - /ie) - X*^^2fc+1 - f^e 

j=l \k=l k=l 

n-1 



X (^2n-l - ei - (ra - l);Us - (X2J-I - ei - (j - l)yUe)) 
n-1 

X ((^2n-l - E(X2„„i) - £1 + /ie) - (X2,-_i - E(X2,-_i) - + fl^ 

j=l 

n-1 

J2 (^2n-l - E(X2„_0 - (X2,_i - E(X2,_i))) 

n — 1 n 

n^n - l)r^' - n^" ^ T^jl = n^'^ri^^ - n^l- ^ r^jl- 
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Hence 



^ ' fc=l ^ k=l ^ 



Convergence (18. 7p implies S^^^ cXeBi and hence n ^iSj"^ 0, thus we obtain (18. lip for 
the subsequence {2n)nen- 

Now we turn to prove (18.121) for the subsequence {2n)n^^. First observe that 



2n n—1 

Mk{Vk-l - E{Vk-l)) = Xl(^2fc+l - fie) [{X2k - 
k=l k=l 


E{X2k)) - {X2k^l - 


E{X2k-i))] 


n 

+ ^(^2fc-Ai£)[(^2fc-l 
k=l 


- E{X2k-l)) - {X2k 


_2 - E{X2k-2))] 


n—1 k 

= J^(^2fc+1 - fie) Y{£2j 
k=l j=l 


71-1 

~ fie) - X(£^2fe+1 - 
k=l 


k 

fie) Y{e2j~l - fie) 
3=1 


n k 

+ Y{e2k- fie)Y{e2j^ 

k=l j=l 


n 

^1 - f^e) - X](£2fc - 
k=l 


k-1 

fie)'Y{e2j - fie)- 


Here the sum of the first and third summands is 






n — 1 k n 

Y{£2k+1 - fie) XI (^2i - fie) + Y{£2k " 
k=l j=l k=l 


k 

- f^e) 5^(^2i-l - fie) 




n k—1 


n j 





X X^(^2fc-1 - fie)ie2j - fie) + Y^ ^i^^J ' f^e){e2k-l - fie 
k=2 j=l j=l k=l 



n n 



n ] 



X X {e2k-l - fie)ie2j - fie) + Y^ ^i^^j " fie)i£2k-l - fie 
j=l k=j+l j=l k=l 

n n 

X(e2fc-1 - fie){e2j - fie) 
j=l k=l 



= '^(^^3 - Xl'^^^fc-i - fie) = nS^^'^r^'^^ 

j=l k=l 

the second summand is 



n.-l 



X](^2fc+1 - fie) X^(^2i-1 - fie)= ^ '^^^j-l " ^e)(£2£-l - fie) 



k=l 



1 
2 



fie 



,fc=l 



k=l 



n 



(r/"))^-E(^2.-i-/ie 



k=l 
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and similarly, the forth summand is 

fc-i 



^{£2k - fie) ^{£2j - /ie) = ^ 



k=l 



k=l 



Consequently, 



2n 



2n 



k=l 



k=l 



By the strong law of large numbers (2n)~^ -^(efc — /ig)^ o"^ as n — > oo, hence we 
obtain f l8.12p for the subsequence (2n)„gN- Note also that the convergence in fl8.12p holds 
almost surely, too. 

Finally, one can show flS.lOp . (18.1 ip and fl8.12p for the subsequence {2n — l)neN in the same 
way. □ 



9 Estimations of moments 

In the proofs of Theorem 12. Theorem 12.21 and Theorem 12.31 good bounds for moments of the 
random variables (Mfc)fcez+, (-^fc)fcez+, (t^fc)fcez+ and {Vk)k&+ are extensively used. First 
note that, for all keN, E{Mk\Tk~i) = and E(Mfc) = 0, since Mk = Xk - E{Xk\ Tk-i)- 

9.1 Lemma. Let {Xk)k^^i be an INAR(2) process. Suppose that Xq = X„i = and 
E{eD < oo. Then, for all k,£eN, 



(9.1) E(MfcM,|J-, 



max{fc,^}— 1 y 



a{l - a)Xk.i + /3(1 - f3)Xk-2 + ^1 k = l, 
k^l, 



(9.2) E{MkM,) 



a{l - a) E(Xfe_i) + /3(1 - /3) E(Xfc_2) + zf k = i, 
^f ky^i, 



(9.3) E{Ml I J-fc_i) = [E(6,i - E(ei,i))3]Xfc_i + [E(r7i,i - E(r/i,i))=^]Xfc_2 + E(£i - E(£i))3, 

(9.4) E(M|) = [E(ei,i - E(ei,i))^] E(Xfc_i) + [E(r/i,i - E(r/i,i))3] E(Xfc„2) + E(5i - E{e,)f. 

Proof. By ([H]) and flO) . 

(9.5) Mfc = ^ (e,, , - E(efc, ,•)) + XI i^lkj - E(r/fc,,)) + (e^ - E{ek)) , A; G N. 

i=i i=i 

For all /c G N, the random variables {$,k,j — ^i^kj), Vkj — ^iVkj), — '^{^k) '■ j £ are 
independent of each other, independent of Tk-i, and have zero mean, thus in case k = i 
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we conclude (EI]) and hence ([92]). If k < then E(MfcM^ | J^^-i) = Mk^{Mi\Fi_i) = 0. 
Thus we obtain (19. ip and (19.21) in case k ^ £. Shedding more hght we give more details for 
deriving (19. 3p and (19. 4p . Namely, using multinomial theorem the above mentioned properties 
of the random variables {^kj — ^{^k,j), Vkj — ^iVkj), — : j G N} yield that 

= [E(ei,i - E(ei,i))3]Xfc_i + [E(r7i,i - E(r7i,i))3]Xfc_2 + E{6^ - E{e^)f. 

This readily implies ( 19. 4p . □ 

9.2 Lemma. Let (Cfc)fceN be independent and identically distributed random variables such 
that E(lCil^) < oo for some ieN. 

(i) // E((^i) 7^ 0, then there exists a polynomial of degree i such that its leading 
coefficient is [E(Ci)] and 

E{{C, + --- + C^Y)=Q,{N), NeN. 

(ii) // E((^i) = 0, then there exists a polynomial of degree at most i/2 such that 

E{{Ci + --- + CNY)=Ri{N), iVGN. 

The coefficients of the polynomials in question depend on the moments E{(1), j = 1, . . . ,i. 
Proof, (i) By multinomial theorem, 



e^ ,...,£„eZa- 



ki+2k2+--+sks=i, 



N\fN-kA fN-k, 

kj[ k2 )"'[ ks 



i\ r Tfci 



(2!)fc2(3!)fc3...(s!)fc. 



[E(Ci)]'^^---[E(Cr)]' 



Since 

/A^\ fN-ki\ [N -ki A;,_i\ A^(A^ - I) ■ ■ ■ {N - ki - k2 A;, + 1) 



^1/ V k2 I \ ks I ki\k2\---ks\ 
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is a polynomial of the variable having degree ki + - ■ ■ + ks ^ i, there is a polynomial Qi of 

degree at most i such that lE((CiH \- CnY) = QeiN), NeN. Note that a term of degree 

i can occur only in the case ki + ■ ■ ■ + kg = i. Since ki + 2k2 + ■ ■ ■ + sk^ = i, we have s = 1 
and ki = i, and the corresponding term of degree i is A^(A^ — 1) ■ ■ ■ {N — i + 1) [lE(Ci)] • 
Hence Qi is polynomial of degree i having leading coefficient [E(Ci)]^. 

(ii) Using again the multinomial theorem we have 



ii : ■ ■ ■ t at: 

^l + -+^iV=^, 



fl,...,fjvSZ+\{l} 



^ /iV\ fN -k-A fN -k9. k 



2k2+3k3+-+sks=e. 



2 — • ■ ■ — IS^s-l 

k2j \ ks J V /c 



X ^' . [E(C,^)] [EiCt)] . 



(2!)fc2(3!)fc3...(s!)fc. 



Here 

/iV\ /iV - A:2\ /iV - A;,_ A ^ iV(iV - 1) ■ ■ ■ (iV - ^2 - fcg h + 1) 

U/v ^3 ; ■ V ) k2m---ks\ 

is a polynomial of the variable having degree k2 + ■ ■ ■ + ks- Since 

i = 2k2 + 3k3 + --- + sks^ 2{k2 + ks + --- + k^), 

we have k2 + ■ ■ ■ + ks ^ i/2 yielding part (ii). Note that if i is even and lE(Ci) 7^ 0, then 
the degree of Re is i/2] if £ is odd and E{Cf) ^ 0, E(Cf) ^ 0, then the degree of Re is 
also £/2. □ 

9.1 Remark. In what follows using the proof of Lemma [9.21 we give a bit more explicit form 
of the polynomial Rg in part (ii) of Lemma 19.21 for the special cases i = 1,2,3,4,5,6. If 
e=l, then E(Ci + --- + C7v) = and i?i : M ^ M, Ri{x) := 0, x eR. 

If i = 2, then 

E((Ci + --- + C7v)') = iVE(CD, 
and i?2 : M ^ K, R2{x) := E{Cf )x, x G M. 
If i = 3, then 

E((Ci + --- + C7v)') = iVE(Cf), 
and i?3 : M ^ M, i?3(a;) := E(Cf)x, x G M. 
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If £ = 4, then 



E((Ci + ■ • • + CnT) = NEiCt) + ( 4T(E(CD)^ 



^2 / 2!2! 

and Ri-.R^R, R4{x) := E{Cf)x + 3{E{Cf)fx{x - 1), x eR. 
If i = 5, then 

E((Ci + ■ ■ ■ + Cn)') = N E{C!) + 2 ^ E(( 

and R^-.R^R, R^ix) := E{Cf)x + 10E{Cf)E{Cf)x{x - 1), xe 
If £ = 6, then 



N\ 6! 



2 / 2!4! 



iV\ 6! 



2 / 3!3! 



iV\ 6! 



3 / 2!2!2! 



and R(^:R-^ 



Rg{x) := E(Ci)x+15E(Cf)E(Cf)x(a;-l)+10(E(Ci))'a;(x-l) + 15(E(Ci))'a;(x-l)(x-2), x G 



□ 



9.3 Lemma. // a + P = 1, then the matrix A defined in fll.2p has eigenvalues 1 and 
a — 1 = —/3, and the powers of A take the following form 



A' 



1 + /3 



1 /3 
1 /3 



+ 



1 + /3 



/3 -/3 
-1 1 



with 



u :- 



1 + 







'l 




, u ■= 




1 




p. 



V :- 



1 + 







' 1 " 




, V : = 




-1 




-1 



Proof. The formula for the powers of A follows by the so-called Putzer's spectral formula, 

□ 



see, e.g., Putzer [25] . 
9.2 Remark. Using Lemma [9.31 we obtain the decomposition 

1 



(9.6) 

with 
(9.7) 



UkU + VkV 



'Uk + m 


1 


"l 




'Uk 


Uk-Vk_ 


1 + 


1 -1 







ken, 



Uk — Xk + pXk-i, Vk — Xk — Xi 



ken. 



Note that (19. 6p is valid for k = with the convention Uq := and Vq := 0. The 
decomposition (19. 6p can be considered as a motivation for the definition of Uk and Vk, k eN, 
given in Sections |3] and [H □ 
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9.4 Lemma. Let {Xk)k^-i be an IN AIi{2) process with parameters (a, /3) G [0, 1]^ such that 
a + f3 = 1 (hence it is unstable). Suppose that Xq = X_i = and ¥.{e{) < oo with some 
ieN. Then E{X^'X^^l^) = 0{n^), n G N, for all £1^2 e Z+ with ii + £2 = i. 

First proof. The statement is clearly equivalent with E(P(X„, ^ cpn^, n eN, for 
all polynomials P of two variables having degree at most i, where cp depends only on P. 

First let us suppose that (a, /3) G (0, 1)^ If £ = 1, i.e., (£1, £2) = (1, 0) or (£1, £2) = (0, 1), 
then to conclude the statement we show that 



(9.8) 



E(X„) = ^„+ 1^(1 -(-«"). neK 



Since E(X„ | = aX„„i + /3X„_2 + /ie, n G N, we have E(X„) = a E(X„„i) +/3 E(X„„2) 

/i£, n G N, yielding that 



n G N. 



" E(X„) " 




a /3 




E(X„_i)' 


+ 


Ate 


= A 




+ 








1 




E(X„_2)_ 









E(X„_2)_ 








By Lemma [9. 3i we get 



E(X„) 







n 



1 + 



1 


, i-(-/3r 


"/3 -/?" 






1 /3_ 




-1 1 


) 






n G N, 



which yields (19. 8p . 

Let us suppose now that the statement holds for 1, — 1. By multinomial theorem, 



(9-9) = E 



^ A;i!A;2!'t3! 



4^ e N. 



Since for all n G N the random variables {^nj, Vn,j, '■ j ^ N} are independent of each other 
and of the cr-algebra J^n-i, we have for all ^1, ^2 ^ Z+ with ii + £2 = ^ 



n-l J 



'1^ 



fcl+fc2+fc3=£i 
'=1.'=2-'=3S2+ 



h\k2\h\ 



M=X„_ 



AT \ ^2^ 

0=1 



E(e^ 



^3^ 



N=X„-2 



Using part (i) of Lemma 19.21 and separating the terms having degree i and less than i, we have 



ki+k2=ei 

^1 7^2 + 



kllk 
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where Q^i/j is a polynomial of two variables having degree at most i — 1. Hence 

ki+k2=ii, ^' ^' 

By the induction hypothesis, there exists a constant cg^^ such that E (Q^^ £2(X„, ^ 
cq^ £ n^~^, n G M. In fact, we have 



(9.10) E(g,,,,,(X„,X„_i)) ^ Qn 

for nGN and £1,^2 with £1+^2 = ^5 where q := maxos;i<c£ cq^ Consequently, we 

have 

^1 '^2 

Similarly, for all ^1,^2 ^ ^+ with fci + ^2 = ^1 , we have 
Hence we have 

ki+k2=ii, ^' ^' h+h=h+ki, 

+ E ^^a'^/3''E(g,,+fc,,fc,(X„_2,X„_3)) +E(g,,,,,(X„_i,X„_2)). 

^1 '^^2 



Applying dnHH]) and 



^1 '^2 



we conclude 



fcl+fc2=£l, ^' ^' il+i2=«2+fcl, 

Using that E(X[Xq) = 0, r, g G Z+ (since Xq = 0), by the same steps, one can derive 

n-l 
i=l 
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that is, E(P(X„, X„_i)) ^ C£n^ for all monomials P{x,y) := x^^y^^, x,y G M, with £1+^2 
£1,4 e Z+. If P has the form 



P{x, y) ■■= ^Pix'y^ ' + Q{x, y), x,y e 



i=0 



where G M, i = 0, . . . , and Q is a polynomial of two variables having degree at most 
£ - 1, then for all n G N, 

E(P(X„,X„_i)) < Yl b*|E(X;X^I\) +E(Q(X„,X„_i)) ^ \p^\A ^' + CQn'-' ^ cpn\ 

where cp := cq + Yfi=o \Pi\-: as desired. 

Next let us suppose that = (1,0). Then = Xn-i + En, n & N, which implies 

that Xn = ^"=1 £i, n G N. By part (i) of Lemma [9721 

(9.11) E{Xi) = Q,(n), n G N, 

where Qi is a polynomial of degree £. If £1,^2 £ Z+ with ii + £2 = ^, then using the 
independence of X„,_i and e„ we have 

HK'Xtl) = mXn^l + enY'Xt,) =^{Y. Q)^n-l^n "^'^-ij 



Using (I9TT|) . 

E(X^X^i) = X] (^')Q,+,,(n - 1)E(4-^) = 0(nO, n G N, 

since for each j = 0, . . . , ^1, the polynomial Qj+^j is of degree ] + C.2 ^ ^, which yields the 
statement in case (a, /3) = (1,0). 

Finally, let us suppose that (a,/3) = (0, 1). Then X„ = Xn-2 + Sn, n E N, which implies 
that 

n n 
i=l i=l 

By part (i) of Lemma 19.21 we have 

E{Xl)=Q,{n), neN, E{X^^_,) = Qe{n), neN, 

where Qe is a polynomial of degree i. Using the independence of X2„ and X2n-i, for 
i^+i^ = £2 e Z+, we have 

E(X2'^X2^^„i) = EiX',i) E(X2'^„i) = g,,(n)g,,(n) = 0(nO, n G N, 
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as desired. Similarly, 

= nx',i.^mxt.^) = QMQiAn - 1) = 0(nO, n e N. 
Hence we have the assertion. 

Second proof. It is enough to prove that there exists some q G M+ such that E(X^iX^ii) ^ 
QTT,^ for all n G N and ^1,^*2 G Z+ with £1 + ^2 = ^- Let us introduce the notation 



Xfe x^fe— 1 v vk—2 V vk—1 \rk 



First we check that 

(9.12) E(X« I = AuX^^l, + ^ + ^„ n G N, A; = 1, . . . , £, 

i=i 

where 

\^,Qk-l ok 



k-l 



A, 



a /3 
1 








5(fc + l)x(fc + l) 



and Bkj G R^"^^)^*^-'"'"^) are appropriate matrices of which the entries are non- negative and 
depend only on a and the moments of £1 of order less than or equal to [k — j) and 

T 



E{e'l) ••• 



For a better understanding, first we give a proof for fl9.12p in the case of = 1 and k = 2. If 
k = 1, then 





a f3 






+ 






1 












If k = 2, then, by (USD, we have 



E(X2|J-„_i)=E 



2! 



k2 



fei + fc2+fc3=2, ^ ^ \ j=l 



J 



aXn^i + a'^{Xl_-^ - + /3X„_2 + /3^(^n-2 ~ + 2a/3X„_iX„_2 

+ 2a(E(ei))X„_i + 2/3(E(ei))X„_2 + H^l), n G N, 
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and hence, using also that 



we have 



E(X(f)|J-„_i) = E 



V 



-82,1 



+ At2, N, 



where 



2a/3 /J^ 
a /3 
1 



and B2 



a/3 + 2aE(ei) a/3 + 2/3E(£i) 
E(ei) 




as desired. In the general case using part (i) of Lemma 19.21 one can prove fl9.12p (giving also 
explicit forms for the matrices Bkj). 

Taking expectation of (19.121) . we have 
(9.13) EiXl^^) = A,E{xi%) + Y,B,,E{X^£,) + n e N, k = 1, . . . ,1 



For a (i- dimensional vector v = (fi)f=i G M*^ and a d x d matrix M 
us introduce the notations 



pdxd 



let 



|v||oo := max \vi\ and ||^||oo := max > 



By the binomial theorem one can easily have ||y4fc||oo = 1, ^ = 1, • • • , ^- We prove the statement 
using a double induction with respect to k E {1, . . . ,£} and e N. First we show that the 
statement holds for k = 1 using induction with respect to n. Namely, we show that 

||E(X«)|U ^cm, nGN, 

where Ci := ||//]^||oo- If n = 1, then 



E{X\ 



E(Xi)" 




E{ei) 


E(Xo)_ 








Ml, 



which implies that || E{X\ )\\oo = Ci. Let us suppose now that || E(X^^)||oo ^ Cim holds 
for m = 1, . . . , n — 1 with n ^ 2. Then, (19.131) . 

II E(X«)|U = WAEixl'l,) + MilU ^ ||AE(xi^2i)|U + ll^illoo 

^ piui|E(xi^i,)IU 



Ia^iIIoo ^ ci(n - 1) + ci = Cin, 
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as desired. 

Let us suppose now that the statement holds for j = 1, ...,£ — 1, i.e., 
II E(X(f))|U ^ c,n\ neN, j = l,...,i-l. 
Next, using induction with respect to n G N we prove that 

||E(XW)|U <Qn^ neN, 

where 

If n = 1, then, using that Xq = and Xi = ei, we have 

T 



E(xf)) = \E{e{) ■ ■ ■ 

which yields that || E(xf'')||oo = ||a*^||oo ^ Q- Let us suppose now that 

||E(XW)|U ^Qm^ m = l,...,n-l, 
where n ^ 2. Then, by f l9.13p . 



i-i 



E(xW)||oo ^ P.||oo||E(X^l,)|U + J]||5.,,||oo||E(X?2i) 
^ ce{n -lY + Y, \\BeJooCj{n - ly + 



^Q(n-1)^+ ^5^Cj||5^j||oo + llM^llooj {n-iy-^ 
= Ci{n-lY-\n- 1 + 1) 

as desired. □ 

9.1 Corollary. Let {Xk)k^_i be an INAR(2) process with parameters (a, /3) G [0,1]^ such 
that a + f3 = 1 (hence it is unstable). Suppose that Xq = X_i = and ^{e{) < oo with 
some i E N. Then 

E{Xi) = 0{k'), E{Mi) = 0{k'/'), E{Ul) = 0(F), E{V,'') = 0{k^), k G N, 
for i,j G with i ^ £ and 2j ^ i. 
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Proof. The estimate lE(X^) = 0{k^) readily follows by Lemma [9.41 Next we turn to prove 
E(M|) = 0(fc^/^). Using f l9.5p and that the random variables {^n,j,Vn,j,£n '■ j ^ ^} are 
independent of each other and of the cr-algebra J^n-i, we have for all n G N, 

f\ ( f 

^1+^2+^3=^, 1- 2- 3- \ \-^^ 



E((£„-E(£0)'^)- 

N=Xr,-2 




M=X„-i 



N 



<;2 



vi=l 



By part (ii) of Lemma 19721 there exist polynomials Q^i, h G N, of degree at most ii/2, and 
Q12, £2 G N, of degree at most £2/2 such that 



E(M^ I Tn-i)= Yl 7WT (^n-i)g.2 E ((51 - E(eO)'^) • 



Hence 



E(M^)= Y 7^7i77E(Q,,(X„_i)Q£2(^n-2))E((£i-E(5i)r^), n e N. 
£1+^2+^3=^, ^' ^' 

<;i,£2,<?3ez+ 



Then 



E(M^)= Yl jjfTl^mUd^n--uX^^,))E{ie,-Eie^)Y-^), n e N, 

<i,f2,f3ez+ 



where Q^^+^j is a polynomial of two variables having degree at most (£1 + £2)/^, and, by 
Lemma 19.41 



E{Mi)^ Y JJ^Pl+,,{n-l)\E{{e^-Eie^)Y^)\, nEN, 

ei+e2+£3=i, ^' ^' ^' 
^1/2/362+ 

where Pi^^+i^ is a polynomial of degree at most (£1 + £2)72 ^ £/2. This implies that 
E(M^) ^ Pij^^i^in — 1) = 0(n*^^i+^2)/2') -v^^i^]-^ gome polynomial Pii+e2 of degree at most 
{£1 + £2)72 ^ £/2, i.e., E(M^) = 0(n^/2) desired. 

Next we turn to prove E{Ul) = 0(/c*), i,k eN with i ^ £. First note that, by power 
mean inequality, for all i G N, 

a + & /o^y 
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yielding that (a + ^ 2*"^ (a* + 6'), a,b ^ 0. Hence, by Lemma [931 

E{Ul) = E((Xfc + /3X,„i)0 ^ 2"'\E{Xl) + (3'E{XI^,)) ^ T~\P,{k) + f3'P,{k - 1)), 
where Pi is a polynomial of degree at most i, which yields that E{Ul) = 0{k^). 

Finally, for 2j ^ £, j G Z^., we prove using induction in k. By 

the recursion Vk = -(3Vk-i + Mfc + /i^, k & N, we have E(Vfc) = -/3E(Vfc„i) + He, k e N, 
with initial value E(Vo) = 0, hence 

fc-i 

E{Vk)=fieJ2(-Py, keN, 

i=0 

which yields that E(|Vfc|) = 0(1). Indeed, for all keN, 



k-l 



1=0 



^ ^ 1^ if ^ /3 < 1, 
1 if /3 = 1, 



where the inequality for the case (3 = 1 follows by that the sequence of partial sums in 
question is nothing else but the alternating one 1, 0, 1, 0, 1,0,.. .. Let us introduce the notation 
Vk '■= Vk ~ lE(Vfc), k E N. Since, by the triangular inequality for the L2j-norm, 

{E{V,'n)^ ^ (e{V,'^))^ +E{m, 



and E(|14|) = 0(1), for proving E{V^^) = 0{y), k e it is enough to show that 
E{V^^) = 0{y), keN. Using again the recursion Vk = —/SVk-i + Mk + /i^, /c G N, we get 
Vk = -PVk-i + Mk, ke n. Hence 

nVk'n)^ ^ (3 (nVk'l^))^ + (E(Mf ))^ = (0((A: - 1)^))^^ + {0{k^))^ = 0{k"% 



where the first inequality follows by the triangular inequality for the L2j-norm, and the second 
one by the induction hypothesis and that E(Mf^') = 0(A;^). Hence E{Vk^) = 0{k^), A; G N, 
as desired. □ 

9.2 Corollary. Let {Xk)k^-i be an INAR(2) process with parameters {a, (3) G [0,1]^ such 
that a + (3 = 1 (hence it is unstable). Suppose that Xq = X_i = and E{e{) < oo with 
some i eN. Then 

(i) for all i,j G Z_|_ with max{i,j} ^ i/2, and for all k > i + ^ + 1, we have 

n 

(9.14) n-" J2 l^k^il -^0 as n^oo, 



k=l 
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(ii) for all i,j E Z+ with max{z,j} ^ i, for all T > 0, and for all k > i + | + we 



have 
(9.15) 



n-- sup |f/f„,jV^L„tjl^O 

t&[0,T] 



as n ^ oo, 



(iii) for all i^jEZ^ with ma,x{i, j} ^ i/A, for all T > 0, and for all k > i + | + |, we 
have 



(9.16) 



n sup 

ie[0,T] 



fc=l 



as n oo. 



Proof. By Cauchy-Schwartz's inequality and Lemma [9. 11 we have 



\fc=l / fc=l fc=l A:=l 

Using Slutsky's lemma this implies ( ]9.14p . 

Now we turn to prove (19.151) . First note that 

(9.17) sup \Ul^,iV{^,^\ ^ sup |f/f„,j| sup \V;^,^l 

t£[0,T] te[0,T] ie[0,T] 

and for all e > and 6 > 0, we have, by Markov's inequality, 

P I sup |f/i„,j| = P fn-^^/* sup |l7f„,j| > ^ J^ml > ^"'n'^'') 



0{n 



e+l-ie/i\ 



ze{l,2,...,n, 



and 



P I ^ sup 

t6[0,T] 
[nT] 



LnTJ 



k=l k=l 



E 



fc=i 



Hence, if £+1— 0, i.e., e > ^i, then 



and if £/2 + 1 - ie/j < 0, i.e., e > -^j, then 



n ^ sup \ULt,\ 

i6[0,T] 

£/2+l , 



as n — )■ oo. 



n sup |V|'^„^|| — > as n — J- oo. 

t6[0,T] 
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By f lOTfll . we get fl9J[5ll . 

Finally, we show f l9.17p . Applying Doob's maximal inequality (see, e.g., Revuz and Yor [26 
Chapter II, Theorem 1.7]) for the martingale 

n 

fe=i 

(with the filtration {J^k)km) and then (15. 6p . we obtain 



■\nt\ 



'\nT\ 



E sup J] [UlVi - E{UlVi I T> 



LnTJ lnT\ 



fc=l 



fc=l 



since E(f/flf^) ^ y'E([/f ) E(Vfc^^) = 0{e'+^) by Corollary O 

9.3 Remark. We note that in the special case i = 2, i = 1, j = 0, we also get 



□ 



(9.18) 

Indeed, by (15. 7p . we have 
(9.19) 



n sup Uint\ — > as n — > oo for ft > 1. 

ie[o,r] 



k=l 



and hence convergence (I9.18P will follow from 



(9.20) 



n sup 

ie[o,r] 



[nt\ 



k=l 



as ri — 7- oo for all k > 1. 



Doob's maximal inequality (see, e.g., Revuz and Yor [26| Chapter II, Theorem 1.7]) for the 
martingale X]f=i^«' kEN, (with the filtration {J^k)kGN) gives 

^(j;jP.JE^M I^^eM^MJ 1 =4^E(M2) = 0(n2), 



since E(M|) = 0(A;) by Corollary O This implies ([920]), hence fl918l) . 
However, it turns out that we do not need this stronger statement. 



□ 
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Appendicies 



A Classification of INAR(2) processes 



An INAR(2) process is called positively regular if there is a positive integer k such that the 
entries of are positive (see Kesten and Stigum [20]). If a > and f3 > then the 
INAR(2) process is positively regular, since 



A = 


a (3 








1 




a /3 



If a = 0, then 



(3 

1 



A 



2k 



1 
1 



+1 



hence the process is not positively regular. If /3 = 0, then 



A' 



a^'-^A 



a 



. k-l 



a 
1 



k G N, 



hence the process is not positively regular. Consequently, an INAR(2) process is positively 
regular if and only if a > and /3 > 0. 

An INAR(2) process is called decomposable if the matrix A is decomposable (see Kesten 
and Stigum [22]). Note that an INAR(2) process is decomposable if and only if the matrix A 
is reducible (see Horn and Johnson [TU Definition 6.2.21]), that is, there exists a permutation 
matrix P E M?^'^ such that 

c 



P^AP 



d 



l" 




a (3 




"o l" 




"o l" 


1 




1 




1 




f3 a 



where b,c,d E M. Since 



we get an INAR(2) process is decomposable if and only if /3 = 0. Moreover, an INAR(2) 
process is indecomposable but not positively regular if and only if a = and /3 > 0. 

Note that an INAR(2) process is positively regular if and only if the matrix A is primitive 
(see Horn and Johnson [HJ Definition 8.5.0 and Theorem 8.5.2]), so this case can also be called 
primitive (see Barczy et al. [H Definition 2.4]). Further we remark that the not positively 
regular case is also called non-primitive. 
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B A version of the continuous mapping theorem 



A function / : IR+ — )■ Mf^ is called cddldg if it is right continuous with left limits. Let D(]R+, Mf^) 
and C(M+, M"^) denote the space of all M*^- valued cadlag and continuous functions on IR+, 
respectively. Let i3(D(M+, M*^)) denote the Borel cx-algebra on D(]R+,M'^) for the metric defined 
in Jacod and Shiryaev [T71 Chapter VI, (1.26)] (with this metric D(M+, Mf^) is a complete and 
separable metric space and the topology induced by this metric is the so-called Skorokhod 
topology). For M'^- valued stochastic processes {yt)tm+ and {yt"'^)tm+, n G N, with cadlag 
paths we write y^""^ ^ y if the distribution of on the space (D(M+, M), i3(D(M+, M*^))) 

converges weakly to the distribution of y on the space (D(M+, M), i3(D(M+, M"^))) as n — t- oo. 
Concerning the notation — > we note that if ^ and n G N, are random elements with 
values in a metric space {E,d), then we also denote by — ^ ^ the weak convergence of 
the distributions of on the space {E,B{E)) towards the distribution of C, on the space 
{E,B{E)) as n — )■ oo, where B{E) denotes the Borel cx-algebra on E induced by the given 
metric d. 

The following version of continuous mapping theorem can be found for example in Kallen- 
berg [IHl Theorem 3.27]. 

B.l Lemma. Let {S,ds) and {T,dj) he metric spaces and {^n)nm! ^ be random elements 
with values in S such that ^„ — y ^ as n —)■ oo. Let f : S ^ T and fn'-S^T, n G N, be 
measurable mappings and C G B{S) such that P(^ G C) = 1 and lim„_^oo dxifnisn), /(■§)) = 
if limn^oo ds{sn, s) = and seC. Then fn{^n) — > f{C) as n^oo. 

For the case S := D(M+,M'^) and T := W (T := D(M+,M«)), where d, g G N, we 
formulate a consequence of Lemma IB.ll 

For functions / and /„, n G N, in D(M+,M''), we write /„ f if (/«)neN 
converges to / locally uniformly, i.e., if sup^g^.T] \\fn{t) — f(t)\\ as n — oo for all 
T > 0. For measurable mappings $ : D(M+, M"^) -> M« (D(M+, M«)) and $„, : D(R+, M*^) ^ 
W (D(M+,M^)), n G N, we will denote by C^,{^^)„^^ the set of all functions / G C(M+,M'^) 
such that $„(/„) ^ $(/) (A $(/)) whenever /„ A / with /„, G D(M+, M"'), n G N. 

We will use the following version of the continuous mapping theorem several times, see, e.g., 
Barczy et al. [3l Lemma 4.2] and Ispany and Pap [T6l Lemma 3.1]. 

B. 2 Lemma. Let d, g G N, and {tlt)tm+ o,nd (w|"^)(giR^, n G N, be W'- -valued stochastic 
processes with cddldg paths such that W^") U. Let $ : D(M+,M'^) W (D(R+,M'?)) 
and : D(R+,M'^) — )■ (D(]R+, R'^)), n G N, be measurable mappings such that there exists 
CcC$,($„)„g„ with C G -B(D(M+,R"')) and ¥{UeC) = l. Then $„(W(")) ^ <I>(W). 

In order to apply Lemma IB.2t we will use the following statement several times. 
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B.3 Lemma. Let d, p, q E N , h : M.'^ ^ 'R'' be a continuous function and K : [0, 1] 
he a function such that for all R> there exists Cr > such that 

(B.l) \\K{s, x) - Kit, y)\\ <:CR{\t-s\ + \\x - y\\) 

for all s,t E [0, 1] and x,y E M^'^ with \\x\\ ^ R and \\y\\ ^ R. Moreover, let us define the 
mappings : D(]R+,M°') W+p, n e N, by 

$(/) := [h{f{l)), j\{uJ{u)J{u))du 

for all f G D(M+,]R'^). Then the mappings $ and $„, n G N, are measurable, and 
= m+,^') e i3(D(M+,M'^)). 

Proof. For an arbitrary Borel set B G B{M.'^~^p) we have 

^-\B) = n^\, ^iK\B)), nGN, 

where for all n G N the mapping : (]R'^)"+^ — > M^+p is defined by 



Kn{Xo,Xi,...,Xn) := ( , - A' (-,Xk,Xk-l] I , Xo,Xi, . . . ,x„ G 



and the natural projections 1^10,11,12,...^ ■ 0(1^+, K'^) — ^ (M'^)"'*^"'^, to, ^1, ^2, • • • , G IR+, are 
given by vri^,^,,^,,,,,,^^ (/) := (/(to), /(tO, /(^2), • • • , /(t„,)), / G D(R+, M'^),Jo, ^1,^2, • • • G M+. 
Since and are continuous, Kn is also continuous, and hence K~^{B) G B{{M.'^)"'~^^) . 
It is known that 7^10,^,12, ...,t„, to, ti, ^2, • • • , tn G M+, are measurable mappings (see, e.g., 
Billingsley [5l Theorem 16.6 (ii)] or Ethier and Kurtz [TOl Proposition 3.7.1]), and hence = 
o 1 2 ^ is also measurable. 

Next we show the measurability of $. Since the natural projection D(]R_|_,R'^) 9 / 1— )■ 
/(I) = vri(/) is measurable, /i is continuous, it is enough to show that the mapping 



D(M+,M^)9/^$(/):= / K{t,f{t)J{t))dt 

Jo 

is measurable. Namely, we show that $ is continuous. We have to check that $(/«) — )■ $(/) 



in RP as n — )■ 00 whenever fn^f in D(]R+,M'^) as — )■ 00, where /, /„ G -D(]R+, ^ 
nGN. Due to Ethier and Kurtz [T0| Proposition 3.5.3], for all T > there exists a sequence 
Xn '■ R+ — )■ R+, nGN, of strictly increasing continuous functions with A„(0) = and 
limj^oo A„(t) = 00 such that 

(B.2) lim sup |A„(t) - t| = 0, lim sup ||/„(t) - /(A„(t))|| = 0. 
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We check that hm„_^oo /n.(^) = /(^) whenever t G IR+ is a continuity point of /. This readily 
follows by 

||/„.(t) - fm < Wfnit) - /(A„(t))|| + ||/(A„(t)) - /(t)||, n e N, t G M+. 

Using that / has at most countably many discontinuities (see, e.g., Jacod and Shiryaev [T71 
page 326]), we have lim„^oo/n(^) = f{t) for all t G IR+ except a countable set having 
Lebesgue measure zero. In what follows we check that 

sup sup \\K{t, fnit)Jnit))\\ <00. 

n&N ie[0,l] 

Since K is continuous and hence it is bounded on a compact set, it is enough to verify that 

sup sup \\fnit)\\ < OO. 

n6N t£[0,l] 

This follows by Jacod and Shiryaev [T71 Chapter VI, Lemma 1.14 (b)], since fn ^ f in 
D(]R+, M*^) yields that {/„, : n G N} is a relatively compact set (with respect to the Skorokhod 
topology). Then Lebesgue dominated convergence theorem yields the continuity of $. 

In order to show C*$^($„)^gj, = C(R+,R'') we have to check that $„(/„) ^{f) whenever 
fn^f with /gC(M+,R'^) and /„ G D(R+, M'^), n G N. We have 

||$.(/n)-<f(/)IK||M/n(l))-M/(l))ll 



n 

n ^ 

k=l 



" pk/n 



n \n 



k-1 



n 



n \n 



K{-,f 



k 

n \n 



f 



k-1 



n 



K{tJ{t)J{t)) 



k-1 



n 



=: ||M/n(l))-M/(l))ll+4^^+4'^- 
Since f implies that /„(1)— 7'/(l) as n->oo, using the continuity of h, we get 

|IM/n(l))-M/(l))ll ^0 as n->oo. 

Let us also observe that 



sup sup ||/„(t)|| ^ sup sup \\fn{t) - f{t)\\ + sup ||/(t)|| =: C < OO, 

n6Nt6[0,l] neNte[0,l] te[0,l] 



hence 



and then, by ( lRT]l . 



fn\ ] J fi 



k-1 



n 



^ V2c, k = 1,. . .,n, n G N, 



AW^v^C^, sup ||/„(t)-/(t)||^0 

t6[0,l] 
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as 77, — oo. Moreover, 



k=iJik-l)/n 



k/n 



- t 



n 



n I \ n 



(fit) Jit)) 



dt 



where 



^ v^C^,(n"^ + a;i(/,n"i)), 



sup 

t,selO,l],\t-s\<e 



fit)-f{s)\\, 



e > 0, 



denotes the modulus of continuity of / on [0,1]. Since / is continuous, Ui{f,n ^) — )• 

('2') 

as n — oo (see, e.g., Jacod and Shiryaev [T71 Chapter VI, 1.6]), and we obtain y4„ — )■ as 
n — )■ oo. Then C$.(<i, 



Finally, C(M+, M'^) G ;B(D(M+, M^)) holds since D(M+, M^) \ C(M+, M"') is open. Indeed, if 



/eD( 



\ C(M+,M'^) then there exists t € M+ such that e := \\f{t) - lim.^f > 0, 



and then the open ball in D(]R_|_, M*^) with centre / and radius e/2 does not contain any 



continuous function. We note that for C(]R_|_,! 
Ethier and Kurtz ^ Problem 3.11.25]. 



e i3(D(l 



^+5 - 



)) one can also simply refer to 



□ 



C Convergence of random step processes 



We recall a result about convergence of random step processes towards a diffusion process, see 
Ispany and Pap [16] . This result is used for the proof of convergence (15. 8p . 

C.l Theorem. Let 7 : x M'^ — )■ M^^'' be a continuous function. Assume that uniqueness 
in the sense of probability law holds for the SDE 



[C.l] 



dUt = -fitMt) dm 



t e 



with initial value Uq = Uq for all Uq G M*^, where {Wt)teR+ is an r- dimensional standard 
Wiener process. Let {lA.t)tm.+ be a solution of fIC.ip with initial value Uq = G M.'^. 

For each n G N, let ([/["■')fcgN be a sequence of d- dimensional martingale differences with 
respect to a filtration (J'f ^)fcez+, i-e., E(C/^"^ | 7"^"^) = 0, n eN, k eN. Let 



[nt\ 





k=l 



k ' 



t E 



n eN. 



Suppose that E < 00 for all n,k eN. Suppose that for each T > 0, 



sup 

ie[o,r] 



k=\ ^ ^ 



0, 



57 



(ii) EE(||t/f)|pl^|,^(.)|,>,Jj-r\)^0 for all 9 > 0, 

where denotes convergence in probability. Then Z//*-"-* — ^ U as n — ?■ oo. 

Note that in (i) of Theorem IC-H || ■ || denotes a matrix norm, while in (ii) it denotes a 
vector norm. 
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